Magnifying observation apparatus

ABSTRACT

To easily obtain a magnified observation image in which a user&#39;s intention is reflected. A side-view image acquired by a side-view image capturing unit is displayed on a display unit. An arbitrary position designation by a user is received on the side-view image displayed on the display unit. A magnifying observation apparatus is controlled based on the received position.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims foreign priority based on Japanese PatentApplication No. 2018-161299, filed Aug. 30, 2018, the contents of whichis incorporated herein by reference.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to a magnifying observation apparatus thatimages an observation target to magnify and display on a display unit.

2. Description of Related Art

For example, as a magnifying observation apparatus which magnifies anddisplays a sample of a micro object and the like, an electroniccomponent, or work such as workpiece, there has been known a magnifyingobservation apparatus that includes an optical system on which reflectedlight or transmitted light from an observation target is incident, and aplurality of light receiving elements two-dimensionally arranged. Thismagnifying observation apparatus is configured to receive light incidentthrough the optical system by the light receiving elements, detects alight receiving amount of each light receiving element to generate animage of the observation target and magnifies and displays the image ona display. Such a magnifying observation apparatus is disclosed, forexample, in JP-A-2014-211626, and is sometimes called a digitalmicroscope, etc. in distinction from an optical microscope.

The digital microscope of JP-A-2014-211626 includes, separately from amicroscope image sensor which captures a magnified observation image ofa sample, a monitoring sensor for capturing a two-dimensional overviewimage of the sample.

Based on the overview image acquired by the monitoring sensor, it ispossible to automatically check whether the sample is correctlypositioned on a sample table, to move the sample in X and Y directionstill the sample reaches a desired observation position, and to designatean area within the overview image and select a desired observationmagnification of that area.

Focusing is essential in observation with a microscope. However, in thedigital microscope, an image of the observation target can be acquiredfrom the light receiving amount of each light receiving element, andthus there is an advantage that focusing can be performed automaticallyby conventional methods such as a contrast autofocusing method and aphase different autofocusing method.

However, since the magnified observation image in the digital microscopeis an image obtained by magnifying the observation target by severaltens to several hundreds of times, and in some cases even at a highermagnification, it has been extremely difficult to intuitively determinewhich part of the observation target the part currently being observedis, or which part of the observation target is in focus. In a word, inthe digital microscope, although a magnified observation image can beeasily obtained by various controls, there are cases where the magnifiedobservation image obtained is not necessarily an image reflecting auser's intention.

SUMMARY OF THE INVENTION

The invention has been devised in view of such points, and an object ofthe invention is to easily obtain a magnified observation image in whicha user's intention is reflected.

In order to achieve the object, a first invention is a magnifyingobservation apparatus which irradiates an observation target withillumination light and detects a light receiving amount of reflectedlight or transmitted light of the illumination light from theobservation target to generate an image of the observation target and todisplay the image to enable a magnified observation, the magnifyingobservation apparatus including: a base unit; a placement unit, which issupported by the base unit, for placing the observation target; anobjective lens on which the reflected light or the transmitted light ofthe illumination light from the observation target is incident; aZ-direction driving unit which moves the placement unit or the objectivelens in a direction towards and away from each other; a first imagingsection which receives the reflected light or the transmitted lightthrough the objective lens to acquire a first image; a second imagingsection which is provided to face the placement unit or the observationtarget and to have an optical axis different from an optical axis of thefirst imaging section, and which acquires a second image including theobservation target; a display unit capable of displaying the first imageacquired by the first imaging section and the second image acquired bythe second imaging section; a receiving unit which receives adesignation of a position in the second image displayed on the displayunit; and a control unit which controls the Z-direction driving unitbased on the position received by the receiving unit.

According to this configuration, the illumination light irradiated tothe observation target placed on the placement unit is reflected fromthe observation target and is incident on the objective lens. When theobservation target has light transmissivity and is illuminated bytransmitted illumination, the transmitted light from the observationtarget is incident on the objective lens. The light incident on theobjective lens is received by the first imaging section to obtain afirst image.

Since the second imaging section provided separately from the firstimaging section faces the placement unit or the observation target, itbecomes possible to acquire them as a second image. The acquired secondimage is displayed together with the first image on the display andincludes the observation target. Therefore, a user can view theobservation target from an angle different from that of the first image.Accordingly, the user can designate, for example, a portion to beobserved or a portion to be focused while viewing the second image, andthe designated position is received by the receiving unit. Since theZ-direction driving unit is controlled based on the position received bythe receiving unit, the user can, for example, control the placementunit such that the portion that the user wants to observe enters thevisual field of the objective lens, and focus on the portion on whichthe user wants to focus. As a result, a magnified observation imagereflecting the user's intention is displayed as the first image on thedisplay unit.

The objective lens may be a single objective lens or may be in a statein which various attachments are attached to the objective lens mainbody. The attachments may be, for example, a ring illumination, etc.

In a second invention, the magnifying observation apparatus includes adriving unit which moves the placement unit or the objective lens in adirection towards and away from each other, and an autofocus unit whichcontrols the driving unit based on the first image acquired by the firstimaging section and searches for a focus of the objective lens, and thecontrol unit controls the driving unit such that the objective lens isfocused on the position received by the receiving unit.

According to this configuration, the user can focus on the positiondesignated in the second image, and thus a magnified observation imagereflecting the user's intention can be obtained.

In a third invention, the magnifying observation apparatus includes animage processing unit which acquires positional relation informationbetween the objective lens and the observation target based on thesecond image acquired by the second imaging section, and the autofocusunit is configured to control, before a designation of a position isreceived by the receiving unit from a user, the driving unit based onthe positional relation information acquired by the image processingunit and the first image acquired by the first imaging section to searchfor the focus of the objective lens.

According to this configuration, the positional relation informationbetween the objective lens and the observation target can be acquiredbased on the second image at the image processing unit. The autofocusunit can control the driving unit based on the positional relationinformation between the objective lens and the observation target tomove the placement unit or the objective lens in a direction towards andaway from each other. As a result, it becomes possible to focus whileavoiding a collision between the objective lens and the observationtarget, and it is possible to display the first image in focus on thedisplay unit to perform a magnified observation of the observationtarget. The autofocus is executed before the designation of the positionfrom the user is received, and thus it is possible to perform a fullyautomatic magnified observation of the observation target without theuser performing a special operation.

In a fourth invention, the receiving unit is configured to receive adesignation of a position from a user when the search for the focus ofthe objective lens by the autofocus unit fails.

According to this configuration, the autofocus is performed before thedesignation of the position from the user is received, and when theautofocus fails, the receiving unit receives the designation of theposition from the user, which enables focusing.

In a fifth invention, the receiving unit is configured to receive adesignation of a position corresponding to an outer shape of theobservation target in the second image.

According to this configuration, the position designated by the user inthe second image can be used as the outer shape of the observationtarget, and thus it can be used, for example, for control to avoid acollision and the like between the objective lens and the observationtarget.

In a sixth invention, the second imaging section acquires a second imageincluding at least a lower end portion of the objective lens, and thereceiving unit is configured to receive a designation of a positioncorresponding to the lower end portion of the objective lens in thesecond image.

According to this configuration, the position designated by the user inthe second image can be used as the lower end portion of the observationtarget, and thus it can be used, for example, for control to avoid acollision and the like between the objective lens and the observationtarget.

In a seventh invention, the magnifying observation apparatus includes anelectric revolver driving unit which rotates a revolver to which aplurality of the objective lenses can be attached, the second imagingsection acquires a second image including a plurality of the objectivelenses, the receiving unit is configured to receive a designation of aposition corresponding to one of the plurality of objective lenses inthe second image, and the control unit controls the electric revolverdriving unit such that an observation from the objective lens at aposition received by the receiving unit becomes possible.

According to this configuration, it is possible to automatically switchto the objective lens at the position designated by the user in thesecond image, and thus a magnified observation image reflecting theuser's intention can be easily obtained.

In an eighth invention, the magnifying observation apparatus includes asynthesis processing unit which performs depth synthesis processing ofgenerating a first image focusing on all parts of a predetermined rangein a height direction of the observation target positioned within visualfield of the first imaging section, the receiving unit is configured toreceive a designation of a position corresponding to at least one of anupper limit and a lower limit of the predetermined range in the secondimage, and the control unit controls the synthesis processing unit suchthat the depth synthesis processing is performed with the positionreceived by the receiving unit as the upper limit or the lower limit ofthe predetermined range.

According to this configuration, the depth synthesis processing isperformed with the position designated by the user in the second imageas the upper limit or the lower limit, or both the upper limit and thelower limit of the depth synthesis range, and thus the depth synthesisprocessing can be performed within a range in which the user's intentionis reflected.

In a ninth invention, the placement unit includes an electric placementtable, and the control unit controls the electric placement table suchthat the position received by the receiving unit enters the visual fieldof the first imaging section.

According to this configuration, the vicinity of the position designatedby the user in the second image can be magnified and displayed on thedisplay unit, and thus it is possible to easily observe the portion thatthe user wants to observe.

In a tenth invention, the second imaging section is positioned above anupper surface of the electric placement table and images the observationtarget in a depth direction of the electric placement table, theelectric placement table is configured to be capable of moving theobservation target in both a width direction and a depth direction ofthe electric placement table, and the electric placement table moves theobservation target in the width direction and the depth direction of theelectric placement table such that the position received by thereceiving unit enters the visual field of the first imaging section.

According to this configuration, since the second imaging section ispositioned above the upper surface of the electric placement table, itis possible to image the observation target not only in the widthdirection, but also in the depth direction of the electric placementtable. As a result, the user can designate a position in both the widthdirection and the depth direction of the electric placement table andcan easily observe the portion the user wants to observe.

In an eleventh invention, the magnifying observation apparatus includesa display control unit which controls the display unit, and the displaycontrol unit causes a guide display which guides a user to designate aposition to be displayed on the display unit such that the guide displayoverlaps the second image.

According to this configuration, the user can easily work by followingthe guide display when the user designates a position while viewing thesecond image.

In a twelfth invention, the guide display is a display regarding aworking distance of the objective lens.

According to this configuration, since the display regarding the workingdistance of the objective lens is displayed overlapping the secondimage, the user can precisely designate the position at which theobjective lens is focused.

In a thirteenth invention, the second imaging section acquires a secondimage including at least an upper surface of the observation target, themagnifying observation apparatus includes an edge extracting unit whichperforms edge extraction processing of extracting the upper surface ofthe observation target included in the second image as an edge, and theguide display is to display the edge extracted by the edge extractingunit as the upper surface of the observation target.

According to this configuration, the upper surface of the observationtarget is included in the second image and by extracting the uppersurface of the observation target, the position of the upper surface ofthe observation target can be grasped. By displaying this as a guidedisplay, it is possible to inform the user of the position of the uppersurface of the observation target. As a result, for example, when theuser tries to move the objective lens in a direction towards theobservation target, the collision of the objective lens with theobservation target can be avoided.

In a fourteenth invention, the receiving unit is configured to becapable of operating a position designation pointer displayed in thesecond image and the receiving unit receives a designation of anarbitrary position by the position designation pointer.

According to this configuration, an arbitrary position can be easilyinput as the user operates the position designation pointer. Theposition designation pointer may be, for example, an arrow, etc.

In a fifteenth invention, the magnifying observation apparatus furtherincludes a Z-direction driving amount determining unit which determinesa driving amount of the Z-direction driving unit based on a position inthe Z direction of the magnifying observation apparatus converted fromthe position in the second image designated by the designation receivedby the receiving unit, and the control unit controls the Z-directiondriving unit based on the driving amount determined by the Z-directiondriving amount determining unit.

In a sixteenth invention, the Z-direction driving amount determiningunit includes an association information storing unit which storesassociation information between a position in the second image and aposition in the Z direction of the magnifying observation apparatus, andthe Z-direction driving amount determining unit determines a drivingamount of the Z-direction driving unit based on the position received bythe receiving unit and the association information.

According to the invention, the second imaging section which acquires animage including the observation target is provided separately from thefirst imaging section which receives the reflected light or thetransmitted light from the observation target via the objective lens,and the user can designate an arbitrary position in the image capturedby the second imaging section and control the magnifying observationapparatus based on the position designation. Therefore, it is possibleto easily obtain a magnified observation image in which the user'sintention is reflected.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a perspective view of an observation unit of a magnifyingobservation apparatus according to Embodiment 1 of the invention asviewed from the front;

FIG. 2 is a right side view of the observation unit of the magnifyingobservation apparatus according to Embodiment 1 of the invention;

FIG. 3 is a front view of the observation unit of the magnifyingobservation apparatus according to Embodiment 1 of the invention;

FIG. 4 is a diagram showing an entire configuration of the magnifyingobservation apparatus according to Embodiment 1 of the invention;

FIG. 5 is a partial cross-sectional view showing a schematicconfiguration of the observation unit of the magnifying observationapparatus as viewed from the right side.

FIG. 6 is a diagram corresponding to FIG. 3 showing a state in which astand is swung left and right;

FIG. 7 is a perspective view showing the configuration of a side-viewimage capturing unit, a cylindrical member, and a fixing bracket;

FIG. 8 is a diagram corresponding to FIG. 2 according to Embodiment 2;

FIG. 9 is a diagram corresponding to FIG. 2 according to Embodiment 3;

FIG. 10 is a diagram corresponding to FIG. 3 according to Embodiment 4;

FIG. 11 is a diagram corresponding to FIG. 5 according to Embodiment 4;

FIG. 12 is a diagram corresponding to FIG. 3 according to Embodiment 5;

FIG. 13 is a diagram corresponding to FIG. 5 according to Embodiment 5;

FIG. 14 is a diagram corresponding to FIG. 3 according to Embodiment 6;

FIG. 15 is a diagram corresponding to FIG. 5 according to Embodiment 6;

FIG. 16 is a diagram showing an example of an interface displayed on adisplay unit;

FIG. 17 is a block diagram of a magnifying observation apparatus;

FIG. 18 is a flow chart showing a work procedure of a user in a fullyautomatic observation;

FIG. 19 is a flow chart showing a processing procedure of the magnifyingobservation apparatus in the fully automatic observation;

FIG. 20 is a diagram showing a side-view image displayed in a side-viewimage display region;

FIG. 21 is a diagram corresponding to FIG. 20 showing an example inwhich an upper surface of an observation target and a lower end portionof an objective lens are edge-extracted and displayed;

FIG. 22A is a diagram corresponding to FIG. 20 showing an example of aside-view image in which a background portion is clearly seen;

FIG. 22B is a diagram corresponding to FIG. 20 showing an example of aside-view image in which the background portion is blurred;

FIG. 23A is a diagram corresponding to FIG. 20 explaining determinationgist of the background portion;

FIG. 23B is a diagram corresponding to FIG. 20 showing an example of aside-view image in which the background portion is masked;

FIG. 24 is a diagram corresponding to FIG. 20 showing an example of aside-view image including an objective lens to which an attachment isattached;

FIG. 25 is a diagram corresponding to FIG. 20 showing an example ofupper limit setting and lower limit setting in synthesis processing;

FIG. 26 is a diagram corresponding to FIG. 20 showing an exampleschematically showing a case positioned outside visual field of aside-view image capturing unit;

FIG. 27 is a diagram corresponding to FIG. 26 showing a state in which arevolver is rotated;

FIG. 28 is a flow chart showing a work procedure of a user in asemi-automatic observation;

FIG. 29 is a flow chart showing a processing procedure of the magnifyingobservation apparatus in a semi-automatic observation;

FIG. 30 is a diagram showing an example of an observation target;

FIG. 31 is a diagram corresponding to FIG. 20 showing an example inwhich a position designation pointer is displayed;

FIG. 32 is a diagram corresponding to FIG. 20 showing an example inwhich an auxiliary display for assisting position designation issuperimposed and displayed;

FIG. 33 is a diagram corresponding to FIG. 20 showing an example inwhich an auxiliary display for supporting collision avoidance issuperimposed and displayed;

FIG. 34 is a diagram corresponding to FIG. 33 in a state in which a headunit is swung;

FIG. 35A is a diagram corresponding to FIG. 20 explaining the gist ofdesignating a focusing position by the position designation pointer;

FIG. 35B is a diagram corresponding to FIG. 35A showing a state in whicha focusing position is designated;

FIG. 35C is a diagram corresponding to FIG. 35A showing a state in whichthe objective lens has moved to the focusing position;

FIG. 36 is a diagram corresponding to FIG. 35A showing a state in whichthe head unit is swung;

FIG. 37 is a diagram corresponding to FIG. 20 showing an example inwhich a lower limit indication line indicating the lower limit ofposition designation is shown;

FIG. 38 is a flow chart showing a work procedure of a user in a manualobservation;

FIG. 39 is a flow chart showing a processing procedure of the magnifyingobservation apparatus in the manual observation;

FIG. 40 is a diagram corresponding to FIG. 20 showing an example inwhich a guide display showing a working distance of the objective lensis superimposed and displayed;

FIG. 41 is a diagram corresponding to FIG. 40 showing a state in whichthe objective lens is moved downward;

FIG. 42 is a diagram corresponding to FIG. 20 showing an example inwhich the working distance of the objective lens is superimposed anddisplayed numerically;

FIG. 43 is a diagram corresponding to FIG. 42 showing a state in whichthe objective lens is moved downward;

FIG. 44 is a diagram corresponding to FIG. 20 showing an example ofmagnified display;

FIG. 45 is a diagram corresponding to FIG. 20 showing a case where theobservation target is positioned outside the visual field of theside-view image capturing unit;

FIG. 46 is a diagram corresponding to FIG. 20 showing an example of awarning display;

FIG. 47 is a diagram corresponding to FIG. 20 showing an example inwhich the outline of the objective lens after switching is superimposedand displayed on a side-view image;

FIG. 48 is a diagram corresponding to FIG. 47 showing a state in whichthe head unit is swung;

FIG. 49A is a diagram showing an auxiliary window of a user interfaceand showing a display example of a navigation image;

FIG. 49B is a diagram corresponding to FIG. 49A showing a displayexample of a side-view image;

FIG. 50 is a diagram showing an electronic component as an observationtarget;

FIG. 51A is a diagram explaining a state in which a resistor isobserved;

FIG. 51B is a diagram showing a state in which the resistor is out offocus due to the presence of a connector on the back;

FIG. 51C is a diagram showing a state in which the resistor is in focusby position designation;

FIG. 51D is a diagram showing a state in which a capacitor is out offocus due to a recess provided in the capacitor; and

FIG. 51E is a diagram showing a state in which the capacitor is in focusby a manual operation.

DESCRIPTION OF EMBODIMENTS

Embodiments of the invention are explained in detail below withreference to the drawings. However, the following description of thepreferred embodiments is merely illustrative in nature, and is notintended to limit the invention, its applications, or its use.

Embodiment 1

FIGS. 1 to 3 show an observation unit 1 of a magnifying observationapparatus according to Embodiment 1 of the invention, and FIG. 4 is adiagram showing an entire configuration of a magnifying observationapparatus A according to Embodiment 1 of the invention. The magnifyingobservation apparatus A magnifies and displays, for example, a sample ofa micro object and the like, an electronic component, or work such asworkpiece (hereinafter referred to as an observation target), and thusis used for a user to inspect the appearance of the observation targetand to conduct a dimension measurement. The magnifying observationapparatus A can also be called, for example, simply a microscope, or adigital microscope. The observation target is not limited to theaforementioned examples, and various objects can be used as theobservation target. Specifically, the magnifying observation apparatus Ais configured to irradiate the observation target placed on a placementunit 30 with illumination light and detect a light receiving amount ofreflected light or transmitted light of the illumination light from theobservation target to generate an image of the observation target and todisplay the image to enable a magnified observation.

As shown in FIG. 4, the magnifying observation apparatus A includes anobservation unit 1, a display unit 2, a controller unit 3, a mouse 4, akeyboard 6 only shown in FIG. 17, and a control unit 60. The observationunit 1 is a part that images the observation target, and it is possibleto image the observation target by a magnified observation imagecapturing unit 50 shown by a broken line in FIG. 3.

The display unit 2 is a part that displays the image captured by theobservation unit 1. The controller unit 3, the mouse 4, and the keyboard6 are members for operating the magnifying observation apparatus; it isnot necessary to include them all, and it is possible to include any oneor two of them. The controller 3, the mouse 4, and the keyboard 6 maybe, for example, a touch panel type input device, a voice input device,etc., as long as they can operate the magnifying observation apparatusA. In the case of the touch panel type input device, it can beintegrated with the display unit 2, and can be configured to make itpossible to detect an arbitrary position on a display screen displayedon the display unit 2. The controller 3, the mouse 4, and the keyboard 6are receiving units which receive an input of an arbitrary positiondesignated by the user on the image displayed on the display unit 2.

Configuration of Observation Unit 1

As shown in FIGS. 1 to 3, the observation unit 1 includes a base unit10, a stand unit 20 to which an objective lens 25 is attached, and aplacement unit 30. In the description of the present embodiment, asshown in FIGS. 1 to 3, the front-rear direction and the left-rightdirection of the observation unit 1 are defined. That is, the sidefacing the user is the front side of the observation unit 1, theopposite side is the rear side of the observation unit 1, the right sideseen from the user is the right side of the observation unit 1, and theleft side seen from the user is the left side of the observation unit 1.The definitions of the front-rear direction and the left-right directionare for helping the understanding of the description; they are notintended to limit the actual use condition, and may be used such thatany direction may be the front.

As shown in FIG. 1, the X direction is defined as the left-rightdirection of the observation unit 1, the Y direction is defined as thefront-rear direction of the observation unit 1, the Z direction isdefined as the vertical direction of the observation unit 1, and thedirection of rotating about an axis parallel to the Z axis is defined asa θ direction. The X direction and the Y direction are orthogonal toeach other on the same horizontal plane. The Z axis is a direction of anormal line orthogonal to this plane. The optical axis of the magnifiedobservation image capturing unit 50 is in the Z-axis direction.

Further, although the detail will be described later, the stand unit 20can swing around an axis U shown in FIG. 1 and FIG. 2 with respect tothe base unit 10 (see FIG. 6). The axis U is orthogonal to the opticalaxis of the magnified observation image capturing unit 50 and extends inthe front-rear direction of the observation unit 1, and is an axisparallel to the Y axis.

The base unit 10 is apart for keeping the observation unit 1 on a deskand the like without shaking the observation unit 1, and is included ina substantially lower half portion of the observation unit 1. As shownin FIG. 1 and FIG. 2, the base unit 10 is provided with the placementunit 30. The placement unit 30 is supported by a portion at the frontside from the vicinity of the central portion in the front-reardirection of the base unit 10, and protrudes upward from the base unit10. The placement unit 30 is a part for placing an observation target,and in this embodiment, it includes an electric placement table. Thatis, it is possible to support an observation target with the observationtarget movable in both the width direction (X direction) and the depthdirection (Y direction) of the electric placement table and rotatable inthe vertical direction (Z direction) and about the Z axis, and theplacement unit 30 includes a placement table 31, a placement tablesupporting unit 32, a placement unit XY-direction driving unit 82 shownin FIG. 17, a placement unit Z-direction driving unit 83, and aplacement unit θ-direction driving unit 84. The placement table 31 isformed such that the upper surface (also referred to as a placementsurface) of the placement table 31 extends substantially horizontally,and the observation target is placed on the upper surface. The placementtable 31 can also be called a stage. The observation target is placed onthe placement table 31 in an atmospheric open state, that is, in a statein which it is not accommodated in a vacuum chamber or the like.

The placement table supporting unit 32 is a part coupling the placementtable 31 and the base unit 10, and is configured to be capable ofaccommodating the placement unit XY-direction driving unit 82, theplacement unit Z-direction driving unit 83, and the placement unitθ-direction driving unit 84, etc. The placement unit XY-directiondriving unit 82 and the placement unit Z-direction driving unit 83respectively include an actuator not shown in the drawings such as astepping motor controlled by the control unit 60, and a motionconversion mechanism which converts the rotation of an output axis ofthe stepping motor into a linear motion, and the placement unitXY-direction driving unit 82 and the placement unit Z-direction drivingunit 83 respectively move the placement table 31 based on a drive pulseoutput from the control unit 60. The placement table 31 can be moved bythe placement unit Z-direction driving unit 83 and an objective lensZ-axis direction driving unit 80 in a direction towards an objectivelens 25 (upward direction) and a direction away from the objective lens25 (downward direction). By moving the placement table 31 in thevertical direction by the placement unit Z-direction driving unit 83,the observation target placed on the placement table 31 is also moved inthe same manner.

The placement unit θ-direction driving unit 84 includes an actuator notshown in the drawings such as a stepping motor controlled by the controlunit 60. The placement unit XY-direction driving unit 82 moves theplacement table 31 in the X direction and the Y direction, the placementunit Z-direction driving unit 83 moves the placement table 31 in the Zdirection, and the placement unit θ-direction driving unit 84 moves theplacement table 31 in the θ direction. The placement unit θ-directiondriving unit 84 may also be omitted. Moreover, the placement table 31can be moved manually in the Z direction by a Z-axis direction operationdial 13 shown in FIG. 1, for example. Although not shown, the placementtable 31 can also be moved manually in the X direction and the Ydirection, as well as the θ direction.

As shown in FIG. 5, a rear side supporting unit 11 and a front sidesupporting unit 12 are provided protruding upward on the rear side ofthe base portion 10 behind the placement table 31. The rear sidesupporting unit 11 and the front side supporting unit 12 are disposed atan interval in the front-rear direction. A circular rear side bearinghole 11 a is formed in the rear side supporting unit 11 to penetrate therear side supporting unit 11 in the front-rear direction. A front sidebearing hole 12 a is formed on the front side supporting unit 12 in thesame manner, and the rear side bearing hole 11 a, and the front sidebearing hole 12 a have centers on the same axis U (shown in FIG. 2,etc.) and are positioned concentrically.

As shown in FIG. 2, etc., the stand unit 20 includes a stand main body21 and a head unit 22, and is included in a substantially upper halfportion of the observation unit 1. The head unit 22 is attached so as tobe vertically movable, that is, movable in the Z-axis direction, by aguiding member 21 b extending in the vertical direction with respect tothe stand main body 21. The head unit 22 is disposed to face an uppersurface of the placement table 31, and revolver 26 to which a pluralityof objective lenses 25 can be attached is provided on the lower sideportion in the head unit 22, that is, the portion facing the uppersurface of the placement table 31. The revolver 26 may be aconventionally known electric revolver, and may also be a manualrevolver.

A plurality of lens attachment holes (not shown) are formed on the lowersurface of the revolver 26 around the rotation axis of the revolver 26.The objective lenses 25 having different magnifications can bedetachably attached to these lens attachment holes. In general, theobjective lenses 25 having different magnifications have differentlengths and outer diameters. Reflected light reflected by the surface ofthe observation target or transmitted light transmitted through theobservation target placed on the placement table 31 is incident on anobjective lens 25 at a usable position. The optical axis of theobjective lens 25 at the usable position is parallel to the Z axis.

The objective lenses 25 to which various attachments are attached canalso be detachably attached to the lens attachment holes of the revolver26. The attachments include, for example, a deflection attachment, adiffusion attachment, a ring illumination attachment, etc.; however,they are not limited thereto, and various attachments can be attached tothe tip end portions of the objective lenses 25. A ring illumination 87may be provided in the head unit 22, and it is controlled to be ON andOFF by the control unit 60 while its brightness is also controlled. Thering illumination 87 is non-coaxial epi-illumination disposed tosurround the objective lens 25 and illuminates an observation target 100from around the optical axis of the objective lens 25.

The head unit 22 is provided with an electric revolver driving unit 81shown in FIG. 17. The electric revolver driving unit 81 is a part thatrotationally drives the revolver 26 to rotate around the rotation axis.The electric revolver driving unit 81 includes an actuator not shown inthe drawings such as a stepping motor controlled by the control unit 60,and rotates the revolver 26 based on a drive pulse output from thecontrol unit 60. As a result, switching to the objective lens 25selected by the user through the operation of the receiving unit isautomatically performed.

The stand main body 21 or the head unit 22 is provided with theobjective lens Z-direction driving unit 80 (shown in FIG. 17) for movingthe head unit 22 in the Z direction. Since the objective lens 25 isattached to the head unit 22, the objective lens Z-direction drivingunit 80 moves the objective lens 25 in a direction towards the placementtable 31 and in a direction away from the placement table 31. Theobjective lens Z-direction driving unit 80 includes an actuator notshown in the drawings such as a stepping motor controlled by the controlunit 60, and a motion conversion mechanism which converts the rotationof an output axis of the stepping motor into a linear motion in thevertical direction, and the objective lens Z-direction driving unit 80moves the head unit 22 based on a drive pulse output from the controlunit 60. The objective lens 25 is moved in the vertical direction byrotating the stepping motor of the objective lens Z-direction drivingunit 80, and in this way a relative distance between the objective lens25 and the placement table 31 can be changed. The objective lensZ-direction driving unit 80 has such a precision that a changing pitchof the relative distance between the objective lens 25 and the placementtable 31 can be set to about 1 nm at a minimum. In addition, theobjective lens 25 can be moved manually in the Z direction by a Z-axisdirection operation dial 23 shown in FIG. 1, for example.

Although not shown, the head unit 22 includes a linear scale (linearencoder) and the like that can detect the relative distance between theobjective lens 25 and the placement table 31. The linear scale isconfigured to be capable detecting the relative distance even if thechange in the relative distance between the objective lens 25 and theplacement table 31 is 1 nm. The detection result of the linear scale isoutput to the control unit 60.

The head unit 22 is provided with the magnified observation imagecapturing unit 50. The magnified observation image capturing unit 50 isa first imaging section that receives reflected light reflected by thesurface of the observation target or transmitted light transmittedthrough the observation target placed on the placement table 31 via theobjective lens 25 to acquire a first image. The first image is alsoreferred to as a magnified observation image for observing theobservation target.

The magnified observation image capturing unit 50 is provided in thehead unit 22 such that the optical axis of the magnified observationimage capturing unit 50 coincides with the optical axis of the objectivelens 25, that is, parallel to the Z axis. The magnified observationimage capturing unit 50 includes, for example, an image sensor such as aCMOS (complementary metal oxide semiconductor) and a CCD (charge coupleddevice), and has a plurality of light receiving elementstwo-dimensionally arranged.

The head unit 22 is provided with a co-axial epi-illumination 51 (shownin FIG. 17). The co-axial epi-illumination 51 is an illumination unitfunctioning as a light resource for illuminating the observation targetvia the objective lens 25, and the co-axial epi-illumination 51illuminates an observation surface of the observation target such thatan illumination light path is positioned on the optical axis of theobjective lens 25. Although not shown, the co-axial epi-illumination 51includes, for example, a light emitting body such as an LED, and alsoincludes a collector, a relay lens, a mirror, and a lens on which lightof the light emitting body is incident. After the light of the lightemitting body passes through the collector and the relay lens, thedirection of the light of the light emitting body is changed by themirror, and then the light is incident on the lens. The direction of thelight emitted from the lens is changed to the direction of theobservation target by a half mirror. Then, the light is irradiated on anobservation optical axis of the objective lens 25 to illuminate theobservation target. ON, OFF, and a light amount during ON of theco-axial epi-illumination 51 are controlled by the control unit 60 whichwill be described later. The co-axial epi-illumination 51 is suitablefor observing a mirror surface or an observation surface similar to themirror surface, and the co-axial epi-illumination 51 has an advantagethat a difference in reflectance of the observation surface can beobserved at high contrast.

Moreover, although not shown, the observation unit 1 is equipped with aconventionally known transmitted illumination. The transmittedillumination is illumination used when the observation target has lighttransmissivity, and the transmitted illumination is configured to emitlight toward the observation target from under the placement table 31.

As shown in FIG. 5, a rear side attaching unit 27 and a front sideattaching unit 28 are provided at the lower portion of the stand mainbody 21 so as to protrude downward. The rear side attaching unit 27 andthe front side attaching unit 28 are disposed at an interval in thefront-rear direction. The rear side attaching unit 27 of the stand mainbody 21 is disposed between the rear side supporting unit 11 and thefront side supporting unit 12 of the base unit 10. The front sideattaching unit 28 of the stand main body 21 is disposed in front of thefront side supporting unit 12 of the base unit 10. A swinging axis 40 isfixed to the rear side attaching unit 27 so as not to be relativelyrotatable. The swinging axis 40 is a hollow axis which is hollow inside,and protrudes to the front and the rear from the rear side attachingunit 27. An axial center of the swinging axis 40 is located on the axisU (shown in FIG. 2, etc.). A front end portion of the swinging axis 40is fixed to the front side attaching unit 28 of the stand main body 21.By fixing the front side attaching unit 28 of the stand main body 21 tothe front end portion of the swinging axis 40, a front side of the heavystand unit 20 can be supported to stabilize the stand unit 20, andeventually, shaking of the head unit 22 can be suppressed.

The swinging axis 40 is supported rotatably around the axis U withrespect to the base unit 10 by a rear side bearing 41 and a front sidebearing 42. The rear side bearing 41 and the front side bearing 42 mayinclude, for example, a cross roller bearing, etc. An outer ring member41 a of the rear side bearing 41 is fitted in a rear side bearing hole11 a of the rear side supporting unit 11 of the base unit 10. Thevicinity of the rear end portion of the swinging axis 40 is insertedinto an inner ring member 41 b of the rear side bearing 41, and theinner ring member 41 b is fixed to the swinging axis 40. A plurality ofrollers 41 c are provided rollably between the outer ring member 41 aand the inner ring member 41 b. In addition, an outer ring member 42 aof the front side bearing 42 is fitted in a front side bearing hole 12 aof the front side supporting unit 12 of the base unit 10. The vicinityof the front end portion of the swinging axis 40 is inserted into aninner ring member 42 b of the front side bearing 42, and the inner ringmember 42 b is fixed to the swinging axis 40. A plurality of rollers 42c are provided rollably between the outer ring member 42 a and the innerring member 42 b.

In a word, since the stand unit 20 includes the head unit (supportingmember) 22 supporting the objective lens 25 and the magnifiedobservation image capturing unit 50, the objective lens 25 and themagnified observation image capturing unit 50 are attached to the standunit 20. Then, since the stand unit 20 including the head unit 22 issupported by the base unit 10 so as to be swingable around the swingingaxis 40 orthogonal to the optical axis of the magnified observationimage capturing unit 50, as shown by virtual lines in FIG. 6, the standunit 20 swings in a left-right direction of the observation unit 1.

As shown in FIG. 5, a brake mechanism 43 is fixed to the base unit 10.The brake mechanism 43 is a mechanism for applying a braking force tothe swinging axis 40 to make the swinging axis 40 not rotatable aroundthe axis U, and may be, for example, a conventionally known brakemechanism configured to be switchable between a state in which atightening force is applied to the swinging axis 40 and a state in whichthe tightening force is not applied. Although an operation of the brakemechanism 43 is not shown in the drawings, it can be performed by a uservia a lever operation from the outside. By operating the brake mechanism43 such that the braking force does not act, the swinging axis 40 canrotate about the axis U. By operating the brake mechanism 43 such thatthe braking force acts, the swinging axis 40 can be stopped at anyrotation position and this stopped state can be maintained. The leverfor operating the brake mechanism 43 is provided with a lock mechanismfor preventing the brake from being released unexpectedly.

A cylindrical member 44 is provided inside the swinging axis 40. Thecylindrical member 44 is formed in a cylindrical shape, is disposedconcentrically with the axial center of the swinging axis 40, that is,the axis U, and extends in the same direction as the swinging axis 40. Afixing bracket 46 is fixed to a rear end portion of the cylindricalmember 44. As shown in FIG. 7, the fixing bracket 46 is formed to belong in the vertical direction, and its upper portion and lower portionare respectively provided with holes 46 a for fastening and fixing. Afastening member such as a screw and a bolt is inserted through eachhole 46 a, and the fixing bracket 46 is fixed to the rear sidesupporting unit 11 of the base unit 10 by the fastening members.

As shown in FIG. 5, a front end portion of the cylindrical member 44 isinserted into a through hole 28 a formed in the front side attachingunit 28 of the stand main body 21. A seal member 44 a is disposedbetween an outer peripheral surface of the front end portion of thecylindrical member 44 and an inner peripheral surface of the throughhole 28 a of the front side attaching unit 28, and via this seal member44 a, the front end portion of the cylindrical member 44 is supported tobe rotatable with respect to the inner peripheral surface of the throughhole 28 a of the front side attaching unit 28.

Inside the cylindrical member 44, a side-view image capturing unit (asecond imaging section) 45 is provided to face the placement unit 30 orthe observation target and to have an optical axis (parallel to the Yaxis) different from the optical axis (parallel to the Z axis) of themagnified observation image capturing unit 50. The swinging axis 40 cansuppress the shaking of the head unit 22 (improve vibration resistance)because it is easy to ensure rigidity by increasing the diameter of theswinging axis 40. However, on the other hand, ensuring a space forarranging such a swinging axis 40 having a large diameter becomes aproblem, and there is a concern that other problems may occur, forexample, it becomes difficult to arrange the side-view image capturingunit 45 around the swinging axis 40. In the present example, theswinging axis 40 is a hollow axis and the inside can be used as a spacefor arranging the side-view image capturing unit 45 and a cable 45 b.Therefore, it is possible to reduce dead space when the swinging axis 40having a large diameter is used.

Similar to the magnified observation image capturing unit 50, theside-view image capturing unit 45 includes an image sensor such as aCMOS and a CCD and has a substrate 45 a. The substrate 45 a is fixed tothe inside of the cylindrical member 44 in a posture extending in thevertical direction. The side-view image capturing unit 45 is fixed tothe front surface of the substrate 45 a.

The cable 45 b, which transmits imaged data from the side-view imagecapturing unit 45 to the control unit 60, is provided. The cable 45 bextends from the side-view image capturing unit 45, passes through theinside of the cylindrical member 44, that is, the inside of the swingingaxis 40, and goes from the rear side of the cylindrical member 44 to theoutside to be connected to the control unit 60. As in this embodiment,in many cases a bearing member, etc., is provided around the swingingaxis 40, and it is difficult to ensure a space for arranging theside-view image capturing unit 45 around the swinging axis 40. However,by making the swinging axis 40 a hollow axis, it is not only possible toeffectively utilize the space inside the swinging axis 40 to arrange theside-view image capturing unit 45 but also to utilize the space insidethe swinging axis 40 as a space for arranging the cable 45 b. As shownin FIG. 7, a blocking plate 44 b for blocking a portion other than theportion where the side-view image capturing unit 45 faces is provided atthe front end portion of the cylindrical member 44.

The side-view image capturing unit 45 is provided in the vicinity of theswinging axis 40, and an optical axis of the side-view image capturingunit 45 is positioned above the upper surface of the placement table 31and above the axis U. As a result, the observation target can be imagedin a depth direction of the placement table 31 by the side-view imagecapturing unit 45, and it is possible to acquire a second imageincluding at least the observation target placed on the placement table31. Further, a second image including at least a lower end portion ofthe objective lens 25 can be acquired by the side-view image capturingunit 45, and a second image including the upper surface of the placementtable 31, the observation target, and the lower end portion of theobjective lens 25 which is observing the observation target can beacquired. When a plurality of objective lenses 25 are attached to therevolver 26, it is also possible to acquire a second image including theplurality of objective lenses 25 by the side-view image capturing unit45. The second image is also referred to as a side-view image because itis an image of the observation target or the placement table 31 viewedfrom the side.

Since the optical axis of the side-view image capturing unit 45 ispositioned above the center of the swinging axis 40, a range in whichthe placement table 31 is reflected in the side-view image can bereduced during eucentric observation. Details of the eucentricobservation will be described later.

The optical axis of the side-view image capturing unit 45 and theswinging axis 40 may be provided such that their centers substantiallycoincide with each other. In addition, the side-view image capturingunit 45 can be provided in the vicinity of a radial center of theswinging axis 40.

Since the side-view image capturing unit 45 is provided to face theplacement table 31 in the rear as compared with the placement table 31,the side-view image capturing unit 45 is provided to image the placementtable 31 from a side opposite to the user side. The swinging axis 40 isprovided on the base unit 10, and thus the side-view image capturingunit 45 is provided on a member which does not move when the objectivelens 25 is driven by the objective lens Z-axis direction driving unit80. When the objective lens 25 is driven by the objective lens Z-axisdirection driving unit 80, the side-view image capturing unit 45 doesnot move. Further, since the cylindrical member 44 is fixed to the baseunit 10 by the fixing bracket 46, the cylindrical member 44 is a memberthat does not swing when the stand unit 20 is swung; the cylindricalmember 44 becomes a non-swinging portion. As a result, the side-viewimage capturing unit 45 is provided on a non-swinging portion.Therefore, the side-view image capturing unit 45 can acquire a side-viewimage including the placement table 31 in a state in which a connectionwith a swinging motion of the stand unit 20 is eliminated.

Further, a position adjustment mechanism which adjusts an attachmentposition of the side-view image capturing unit 45 may be provided. Theposition adjustment mechanism can adjust the side-view image capturingunit 45 in the X direction, the Z direction, and a rotational directionaround the axis U. The attachment position of the side-view imagecapturing unit 45 is preferably done before out-of-factory shipping.

Moreover, a focal distance of the side-view image capturing unit 45 isset to be longer than a focal distance of the magnified observationimage capturing unit 50. The reason thereof will be described later.

Embodiment 2

FIG. 8 shows the observation unit 1 according to Embodiment 2 of theinvention. Embodiment 2 differs from Embodiment 1 in that the side-viewimage capturing unit 45 is provided on the base unit 10, and other partsof Embodiment 2 are the same as those of Embodiment 1. Therefore, theparts the same as those of Embodiment 1 are given with the samereference numerals as in Embodiment 1, and the description thereof isomitted. The parts different from Embodiment 1 will be described.

On the base unit 10 of Embodiment 2, an image capturing unit supportingunit 49 is provided as a non-swinging portion at the rear of theplacement table 31 to protrude upward. The side-view image capturingunit 45 is attached to an upper portion of the image capturing unitsupporting unit 49. As a result, the side-view image capturing unit 45can acquire a side-view image including the placement table 31 in astate in which a connection with a swinging motion of the stand unit 20(the head unit 22) is eliminated. In Embodiments 1 and 2, the height ofthe side-view image capturing unit 45 can be set constant at all times.

Embodiment 3

FIG. 9 shows the observation unit 1 according to Embodiment 3 of theinvention. Embodiment 3 differs from Embodiment 1 in that the side-viewimage capturing unit 45 is provided on the head unit 22, and theside-view image capturing unit 45 is configured to be capable of movingin the same direction as the objective lens 25. Other parts ofEmbodiment 3 are the same as those of Embodiment 1. Therefore, the partsthe same as those of Embodiment 1 are given with the same referencenumerals as in Embodiment 1, and the description thereof is omitted. Theparts different from Embodiment 1 will be described.

On the head unit 22 of Embodiment 3, the image capturing unit supportingunit 49 is provided at the rear of the revolver 26 to protrude downward.The side-view image capturing unit 45 is attached to a lower portion ofthe image capturing unit supporting unit 49. Since the side-view imagecapturing unit 45 is attached to the head unit 22, the side-view imagecapturing unit 45 can be moved in connection with a movement of the headunit 22 in the vertical direction and the height of the side-view imagecapturing unit 45 can be changed. In Embodiment 3, since the side-viewimage capturing unit 45, the objective lens 25, and the magnifiedobservation image capturing unit 50 are attached to the head unit 22,their relative positional relation does not change.

In Embodiment 3, the position of the side-view image capturing unit 45can be set such that a focal position of the objective lens 25 enters avisual field of the side-view image capturing unit 45. It is preferablethat the focal position of the objective lens 25 comes at the center ofthe visual field of the side-view image capturing unit 45. In addition,the image capturing unit supporting unit 49 may be provided on the standmain body 21.

Embodiment 4

FIG. 10 and FIG. 11 show the observation unit 1 according to Embodiment4 of the invention. In Embodiment 4, a supporting unit 14 (shown in FIG.11) is provided on the base unit 10 to protrude upward. Other parts arethe same as those of Embodiment 1. Therefore, the parts the same asthose of Embodiment 1 are given with the same reference numerals as inEmbodiment 1, and the description thereof is omitted. The partsdifferent from Embodiment 1 will be described.

A bearing hole 14 a is formed in the supporting unit 14 so as topenetrate the supporting unit 14 in the front-rear direction, and outerring members of the rear side bearing 41 and the front side bearing 42are fitted in the bearing hole 14 a. The rear side and the front side ofthe swinging axis 40 are respectively formed to pass through the rearside attaching unit 27 and the front side attaching unit 28 of the standmain body 21 in the front-rear direction and are fixed to the rear sideattaching unit 27 and the front side attaching unit 28. The side-viewimage capturing unit 45 is provided inside the swinging axis 40.

In Embodiment 4, when the stand unit 20 is swung, the side-view imagecapturing unit 45 is rotated together with the swinging axis 40.However, since the side-view image capturing unit 45 is positioned nearthe axis U, a displacement amount associated with the swinging of thestand unit 20 is smaller than a case where the side-view image capturingunit 45 is positioned far from the axis U. Therefore, the side-viewimage capturing unit 45 is provided to acquire a side-view imageincluding the placement table 31 in a state in which the connection witha swinging motion of the stand unit 20 is lowered.

Embodiment 5

FIG. 12 and FIG. 13 show the observation unit 1 according to Embodiment5 of the invention. In Embodiment 5, a supporting unit 15 (shown in FIG.13) is provided on the base unit 10 to protrude upward. Parts other thanthe ones to be described below are the same as those of Embodiment 1.Therefore, the parts the same as those of Embodiment 1 are given withthe same reference numerals as in Embodiment 1, and the descriptionthereof is omitted. The parts different from Embodiment 1 will bedescribed.

A cylindrical member 15 a is fixed to the supporting unit 15 to protrudeforward. An axial center of the cylindrical member 15 a is located onthe axis U. A bearing hole 20 a is formed in the stand unit 20 so as topenetrate the stand unit 20 in the front-rear direction, and outer ringmembers of the rear side bearing 41 and the front side bearing 42 arefitted in the bearing hole 20 a. The cylindrical member 15 a is insertedinto inner ring members of the rear side bearing 41 and the front sidebearing 42. As a result, in Embodiment 5, the stand unit 20 swingsaround the cylindrical member 15 a. The swinging axis of Embodiment 5 isa virtual axis and is the axis U. The side-view image capturing unit 45is provided inside the cylindrical member 15 a. In the case ofEmbodiment 5, the side-view image capturing unit 45 can acquire aside-view image including the placement table 31 in a state in which aconnection with a swinging motion of the stand unit 20 is eliminated.

Embodiment 6

FIG. 14 and FIG. 15 show the observation unit 1 according to Embodiment6 of the invention. In Embodiment 6, an arc shaped rail member 17 isprovided on the base unit 10. Parts other than the ones to be describedbelow are the same as those of Embodiment 1. Therefore, the parts thesame as those of Embodiment 1 are given with the same reference numeralsas in Embodiment 1, and the description thereof is omitted. The partsdifferent from Embodiment 1 will be described.

The arc shaped rail member 17, which has a predetermined radius and iscentered on a virtual axis extending in a direction (Y direction)orthogonal to the optical axis of the magnified observation imagecapturing unit 50, is provided on the base unit 10 to protrude upward.The virtual axis is a swinging axis. In addition, an image capturingunit supporting unit 16 to which the side-view image capturing unit 45is attached is provided on the base unit 10.

As shown in FIG. 15, a movable member 29 is attached to the rail member17. The movable member 29 moves in a direction in which the rail member17 extends. However, the movable member 29 engages with the rail member17 so as not to move in a direction away from the rail member 17. Theobjective lens 25 and the magnified observation image capturing unit 50are attached to the movable member 29, and thus the movable member 29 isequivalent to a supporting member. As the movable member 29 moves alongthe rail member 17, the movable member 29 swings around the virtual axisorthogonal to the optical axis of the magnified observation imagecapturing unit 50, and the objective lens 25 swings accordingly. In thecase of Embodiment 6, the side-view image capturing unit 45 can alsoacquire a side-view image including the placement table 31 in a state inwhich a connection with a swinging motion of the stand unit 20 iseliminated.

Configurations to be described below are common to Embodiments 1 to 6.

Eucentric Mechanism

The observation unit 1 is configured to be capable of performing aeucentric observation. That is, in the magnifying observation apparatusA, an apparatus-specific three-dimensional coordinate system formed bythree axes respectively parallel to the X direction, the Y direction,and the Z direction is defined. A coordinate of an intersectionposition, which will be described later, in the three-dimensionalcoordinate system of the magnifying observation apparatus A is furtherstored in a storing unit 89. Coordinate information of the intersectionposition may be stored in advance in the storing unit 89 at the time ofout-of-factory shipping. In addition, the coordinate information of theintersection position stored in the storing unit 89 may be updatable bythe user of the magnifying observation apparatus A.

The optical axis of the objective lens 25 intersects with the axis U.When the objective lens 25 swings centering the axis U, an angle of theoptical axis with respect to the upper surface of the placement table 31changes with the intersection position of the optical axis of theobjective lens 25 and the axis U being maintained constant. Accordingly,when the user swings the objective lens 25 centering the axis U by thehead unit 22, for example, in a case where an observation target portionof the observation target is at the intersection position, a eucentricrelation in which visual field center of the magnifying observationimage capturing unit 50 does not move from the same observation targetportion is maintained even if the objective lens 25 is in a tiltedstate. Therefore, it is possible to prevent the observation targetportion of the observation target from being out of the visual field ofthe magnified observation image capturing unit 50 (the visual field ofthe objective lens 25).

Configuration of Display Unit 2

The display unit 2 a includes, for example, a display screen 2 a capableof color display such as a liquid crystal display panel and an organicEL panel, and power is supplied from the outside. A touch operationpanel (an example of a receiving unit) may be incorporated in thedisplay screen 2 a. Further, in the present embodiment, as shown in FIG.4, an example in which the control unit 60 is incorporated in thedisplay unit 2 is described. However, the invention is not limitedthereto; the control unit 60 may be incorporated in the observation unit1 or may be incorporated in the controller unit 3, or may be an externalunit separate from the display unit 2, the observation unit 1, and thecontroller unit 3. The display unit 2 and the observation unit 1 areconnected by a cable 5 so that the display unit 2 and the observationunit 1 can transmit and receive signals. The cable 5 also includes thecable 45 b (shown in FIG. 5) that transmits imaged data from theside-view image capturing unit 45. Power supply to the observation unit1 may be performed by the cable 5, and may also be performed by a powercable which is not shown in the drawings.

Configuration of Controller Unit 3

The controller unit 3 is connected to the control unit 60. Thecontroller unit 3 is different from a general keyboard or mouse, and isa dedicated operation device capable of operating the observation unit 1and performing input and selection operation of various information,image selection operation, area designation, position designation, etc.As shown in FIG. 17, the mouse 4 and the keyboard 6 are also connectedto the control unit 60. The mouse 4 and the keyboard 6 areconventionally known devices for computer operation.

In addition to the aforementioned devices, the magnifying observationapparatus A may also be connected with a device for performingoperations and controls, a printer, a computer for performing variousother processing, a storing device, a peripheral device, and the like.Connection in this case may be, for example, serial connection such asIEEE 1394, RS-232x, RS-422, and USB, parallel connection, or a method ofelectrically, or magnetically, or optically connecting via a networksuch as 10BASE-T, 100BASE-TX, and 1000BASE-T may be used. In addition towired connection, wireless connection using a wireless LAN such asIEEE802.x, a radio wave such as Bluetooth (registered trademark), aninfrared ray, optical communication, etc. may also be used. Further, asa storing medium used for a storing device for exchanging data andstoring various settings, for example, various memory cards, magneticdisks, magneto-optical disks, semiconductor memories, hard disks and thelike can be used. The magnifying observation apparatus A can also bereferred to as a magnifying observation system in which theaforementioned various units and devices are combined.

Configuration of Control Unit 60

The control unit 60 is a unit for controlling each unit of themagnifying observation apparatus A and performing various calculationsand processing, etc., and can include a CPU, an MPU, a system LSI, aDSP, or a dedicated hardware, etc. As shown in FIG. 17, the control unit60 is provided with an image processing unit 61, an edge extracting unit62, an autofocus unit 63, a display control unit 64, a backgroundinfluence reducing unit 65, a position index calculating unit 66, asynthesis processing unit 67, and a leveling unit 68. Each of the unitsincluded in the control unit 60 is a part capable of realizing variousfunctions as described later. However, the functions may be realized bya logic circuit, or may be realized by executing software, or may berealized by a combination of a logic circuit and software. A part of theunits included in the control unit 60 may be incorporated in theobservation unit 1 while the other part may be incorporated in thedisplay unit 2, or a part of the units may be incorporated in thecontroller unit 3.

The display control unit 64 generates, as shown in FIG. 16, a userinterface 70 and controls the display unit 2 such that the userinterface is displayed on the display screen 2 a of the display unit 2.The user interface 70 includes a magnified observation image displayregion 70 a which displays an image acquired by the magnifiedobservation image capturing unit 50, and a side-view image displayregion 70 b which displays an image acquired by the side-view imagecapturing unit 45. The size of one of the magnified observation imagedisplay region 70 a and the side-view image display region 70 b may besmaller than the size of the other, or the size of the magnifiedobservation image display region 70 a and the size of the side-viewimage display region 70 b may be may be the same. In this example, thedisplay control unit 64 makes a magnified observation image displayedlarger than a side-view image.

As shown in a magnified manner in FIG. 20, the side-view image displayedin the side-view image display region 70 b includes at least the uppersurface of the placement table 31, the observation target 100, and theobjective lens 25. In other words, an angle of view of the opticalsystem (lens) of the side-view image capturing unit 45, and a distancebetween the side-view image capturing unit 45 and the observation target100 are set such that at least the upper surface of the placement table31, the observation target 100, and the objective lens 25 are included.It is also fine that, for the objective lens 25, only the lower endportion enters the visual field of the side-view image capturing unit45.

The control unit 60 is configured to be capable of displaying, among theobjective lens 25 and the observation target 100, the one that ispositioned outside the visual field of the side-view image capturingunit 45 on the display unit 2 in a schematic view. This example is shownin FIG. 26. A portion to which thin ink is not attached in FIG. 26 isthe visual field of the side-view image capturing unit 45 and is aside-view image captured by the side-view image capturing unit 45. Aportion to which thin ink is attached in FIG. 26 is a schematic view. Anobjective lens 25A exists outside the visual field of the side-viewimage capturing unit 45, and this portion is a portion drawn usinginformation on shape or size of the objective lens 25A stored in thestoring unit 89. For the revolver 26, it is also only necessary to storeinformation on shape or size of the revolver 26 in the storing unit 89,and as a result, the revolver 26 can be displayed as a schematic view.

FIG. 45 shows a case where the observation target 100 is positionedoutside the visual field of the side-view image capturing unit 45. Inthis case, a distance between the objective lens 25 and the placementtable 31 can be displayed.

As shown in FIG. 27, an index 91 indicating the upper surface of theobservation target 100 can be displayed on the display unit 2. The uppersurface of the observation target 100 can be acquired by the edgeextracting unit 62 to be described later. When the revolver 26 isrotated to switch the objective lens 25, it can be seen that theobjective lens 25A after switching touches the index 91 indicating theupper surface of the observation target 100 during the switchingoperation. As a result, it can be seen that the objective lens 25 andthe observation target 100 collide before switching to the objectivelens 25A. By displaying the index 91 on the display unit 2, a collisionbetween the objective lens 25 and the observation target 100 can beavoided when the revolver 26 is rotated.

As a method for avoiding the collision between the objective lens 25 andthe observation target 100, for example, as shown in FIG. 33, thehighest part of the observation target 100 may be obtained by edgeextraction and the like, a caution region 93 may be set upward from thatpart, and the caution region 93 may be displayed superimposed on theside-view image. As a result, for example, when the user designates aposition, it is possible to recognize in advance a portion where theobjective lens 25 tends to collide. Therefore, it is possible to avoidthe collision between the objective lens 25 and the observation target100. The caution region 93 is a portion shown by thin ink in FIG. 33.Examples of display forms of the caution region 93 include coloring,diagonal line indication, etc., and the display forms are not limitedthereto.

As shown in FIG. 34, when the head unit 22 is swung, the caution region93 is also in a tilted state corresponding to a swing angle of the headunit 22.

Configuration of Edge Extracting Unit 62

The edge extracting unit 62 is configured to perform an edge extractionprocessing of extracting the upper surface of the observation target 100included in the side-view image as an edge. The edge can be defined in abroad sense as a contour or outline of the observation target 100.However, in this example, description will be made to a case where theupper surface when the observation target 100 is viewed from the side isextracted as an edge. A conventionally known method may be used for theedge extraction processing. For example, a pixel value of each pixel onthe image is acquired, and when there is a region where a change in thepixel value on the image is equal to or more than a threshold for edgedetection, that boundary portion is extracted as an edge. When the uppersurface of the observation, target 100 is extracted as an edge, as shownin FIG. 21, the display control unit 64 controls the display unit 2 suchthat the edge is indicated by an observation target edge indication line71 a. The observation target edge indication line 71 a may include, forexample, a thick line, a broken line, or a line of a striking color suchas red and yellow. However, the observation target edge indication line71 a is not limited thereto, and may be in a form of flashingindication, etc. When there are a plurality of observation target edgeindication lines 71 a, it is fine that only the uppermost observationtarget edge indication line 71 a is displayed.

The edge extracting unit 62 also extracts the lower end portion of theobjective lens 25 included in the side-view image as an edge using themethod as described above. When the lower end portion of the objectivelens 25 is extracted as an edge, as shown in FIG. 21, the displaycontrol unit 64 controls the display unit 2 such that the edge isdisplayed by an objective lens edge indication line 71 b. The objectivelens edge indication line 71 b can be configured in the same manner asthe observation target edge indication line 71 a. The display forms ofthe objective lens edge indication line 71 b and the observation targetedge indication line 71 a may be different or may be the same.

The control unit 60 is configured to perform illumination control ofilluminating the observation target 100 with a coaxial epi-illumination51 when the side-view image capturing unit 45 acquires a side-view imageon which the edge extracting unit 62 performs edge extractionprocessing. For example, before the side-view image capturing unit 45acquires a side-view image on which the edge extraction processing isperformed, when the observation target 100 is illuminated with a ringillumination 87, a side-view image for edge extraction processing isacquired by the side-view image capturing unit 45 after turning off thering illumination 87 and turning on the coaxial epi-illumination 51. Thering illumination 87 irradiates light from around the observation target100, and thus reflection components of the light become strong andhalation occurs in many parts in the side-view image, which may make theedge extraction processing difficult. The illumination may be turned offto extract an edge with ambient light and the illumination may be turnedon when autofocus is performed. When the coaxial epi-illumination 51 isused, halation hardly occurs in the side-view image and the edgeextraction processing becomes easy.

Background Influence Reducing Section

As shown in FIG. 22A, the side-view image on which the edge extractionprocessing is performed may include a background portion (indicated byreference numeral 72). That is, the side-view image capturing unit 45faces the placement table 31 and the observation target 100, and amongthe side-view image acquired by the side-view image capturing unit 45, aregion occupied by the placement table 31 and the observation target 100is a part of the side-view image. In the rest part of the side-viewimage, as shown by the reference numeral 72 in FIG. 22A, an objectfarther than the observation target 100 (a background object fartherthan the front end of the placement table 31) may be reflected, whichbecomes a background portion of the side-view image. The backgroundportion may include objects, people, etc. When the background portion isclearly reflected in the side-view image, it becomes difficult todistinguish between the placement table 31 and the background, betweenthe observation target 100 and the background, and between the objectivelens 25 and the background. Therefore, it may be difficult to grasp theplacement table 31, the observation target 100, and the objective lens100 in the side-view image. In particular, when the edge extractionprocessing is to be performed using the side-view image in which thebackground portion is clearly reflected, the outline of the backgroundobject 72 may be extracted and it becomes difficult to extract the edgeof the observation target 100 or the edge of the objective lens 25.

This example is provided with a background influence reducing sectionthat reduces the influence of the background portion, which is a portionwhere, among the side-view image acquired by the side-view imagecapturing unit 45, the distance from the side-view image capturing unit45 is larger than the distance to the observation target 100. “Reducingthe influence of the background portion” includes methods of blurringthe background portion or masking the background portion such that itbecomes easy to distinguish between the placement table 31 and thebackground, between the observation target 100 and the background, andbetween the objective lens 25 and the background, and also includesmethods of blurring the background portion such that the edge extractionin the background portion cannot be performed. “Blurring the backgroundportion such that edge extraction cannot be performed” means that it canbe set based on the threshold for edge detection and the change in thepixel value in the background portion is made less than the thresholdfor edge detection.

As an example of the background influence reducing section, a depth offield setting section that sets a depth of field of the side-view imagecapturing unit 45 can be mentioned. By setting the depth of field of theside-view image capturing unit 45, it is possible to acquire a side-viewimage in which the background portion is blurred as compared with theplacement table 31 or the objective lens 100. By blurring the backgroundportion, the influence of the background portion can be reduced. Thedepth of field setting section can be, for example, an aperture, anangle of view (focal distance) of a lens of the side-view imagecapturing unit 45, etc. It is possible to calculate the depth of fieldby desktop calculation by a known math formula, and it is also possibleto set a suitable aperture or an angle of view by experiment. By settingthe focal distance of the side-view image capturing unit 45 to be longerthan the focal distance of the magnified observation image capturingunit 50, it is possible to acquire a side-view image in which thebackground portion is blurred as compared with the placement table 31and the observation target 100.

The depth of field of the side-view image capturing unit 45 can be setarbitrarily according to the aperture, the angle of view of the lens,etc. In this example, the depth of field of the side-view imagecapturing unit 45 is set between an end portion of the placement table31 at a side closer to the side-view image capturing unit 45 and an endportion of the placement table 31 at a side farthest from the side-viewimage capturing unit 45. The end portion of the placement table 31 atthe side closer to the side-view image capturing unit 45 is the frontend portion of the placement table 31, and the end portion of theplacement table 31 at the side farthest from the side-view imagecapturing unit 45 is the rear end portion of the placement table 31. Bysetting the depth of field in this manner, as shown in FIG. 22B, theobservation target 100 placed on the placement table 31 and theobjective lens 25 are in focus and a side-view image in which thebackground object 72 is blurred can be acquired. As a result, aside-view in which the observation target 100 and the objective lens 25are conspicuous is obtained.

Further, the depth of field of the side-view image capturing unit 45 canbe set such that a side-view image which focuses on the optical axis ofthe objective lens 25 and is blurred at an end portion of the placementtable 31 which is farther from the stand unit 20 (the front end portionof the placement table 31) is obtained.

As another example of the background influence reducing section, anexample including a background influence reducing unit 65 shown in FIG.17 can be mentioned. The background influence reducing unit 65 includesa background determining unit 65 a which determines the backgroundportion of the side-view image acquired by the side-view image capturingunit 45. The background determining unit 65 a is configured to drive theplacement table 31 in the vertical direction by the placement unitZ-direction driving unit 83 during imaging by the side-view imagecapturing unit 45, and determine a portion not moving in the side-viewimage as the background portion. Further, the background determiningunit 65 a can also be configured to perform image processing on an imagebefore moving captured by the side-view image capturing unit 45 beforethe placement table 31 is driven by the placement unit Z-directiondriving unit 83 and an image after moving captured by the side-viewimage capturing unit 45 after the placement table 31 is driven by theplacement unit Z-direction driving unit 83, and determine a portion notmoving in both images as the background portion.

In FIG. 23A, solid lines indicate a state before the placement table 31is driven by the placement unit z-direction driving unit 83 in thevertical direction, and virtual lines indicate a state after theplacement table 31 is driven by the placement unit z-direction drivingunit 83 in the vertical direction. As shown in FIG. 23A, it is theplacement table 31 and the observation target 100 that move when theplacement table 31 is driven, and the background object 72 does notmove. On this basis, the image before driving and the image afterdriving are subjected to image processing to extract a portion that isnot moving, and this portion is determined as the background portion. Inother words, the side-view image capturing unit 45 can be configuredsuch that a side-view image is acquired when the placement table 31 isat a first position and a side-view image is acquired after theplacement table 31 is moved from the first position to a second positionby the placement unit Z-direction driving unit 83. In this way, thedetermination of the background portion becomes easy.

As a method of determining the background portion, in addition todriving the placement table 31 in the Z direction, it is also possibleto drive the placement table 31 in the Y direction by the placement unitXY-direction driving unit 82. In addition, by driving the objective lens25 in the vertical direction by the objective lens Z-direction drivingunit 80, it is possible to avoid determining the objective lens 25 as abackground portion.

The background determining unit 65 a may also be configured to changethe illumination to the observation target 100 during imaging by theside-view image capturing unit 45 and to determine the backgroundportion based on brightness of each portion of the side-view image. Thering illumination 87 and the co-axial epi-illumination 51 areilluminations illuminating the observation target 100, and lights of thering illumination 87 and the co-axial epi-illumination 51 hardly reachthe background object 72. When lighting states of the ring illumination87 and the co-axial epi-illumination 51 are switched during imaging bythe side-view image capturing unit 45, the brightness of the observationtarget 100 in the side-view image changes significantly. On thecontrary, the brightness of the background object 72 hardly changes.Therefore, this can be detected by image processing, and a portion wherethe change in brightness in the side-view image is less than apredetermined amount can be determined as a background portion. Theswitching of the lighting states of the ring illumination 87 and theco-axial epi-illumination 51 may be switching between ON and OFF, andmay also be a change in brightness.

The background influence reducing unit 65 is configured to reduce theinfluence of the background portion by performing image processing onthe background portion determined by the background determining unit 65a. For example, as shown in FIG. 23B, mask processing can be performedto mask the background portion in the side-view image. The maskprocessing is processing of hiding the background portion. Thebackground portion may be completely hidden, or may be hidden to anextent that the background object 72 is displayed in a lighter color.The mask processing may be, for example, processing of lightly coloringthe background portion, or processing of reducing a contrast of thebackground portion. In addition, the background influence reducing unit65 may perform processing of blurring the background portion.

An image in which the influence of the background portion has beenreduced as described above is displayed on the display unit 2 togetherwith a magnified observation image as shown in FIG. 16.

Configuration of Objective Lens 25

FIG. 24 shows an example of a side-view image including the objectivelens 25 to which an attachment 25 a is attached. When the attachment 25a is attached to the lower end portion of the objective lens 25, adistance to the placement table 31 and a distance to the observationtarget 100 become shorter accordingly.

An identification section may be attached to the attachment 25 a. As anidentification section, for example, a barcode, a two-dimensional code,an IC chip and the like can be mentioned. When a code such as a barcodeand a two-dimensional code is attached, it is preferable to display thecode on a side surface of the attachment 25 a at a portion facing theside-view image capturing unit 45. In a case of an IC chip, it ispreferable to provide a contact at a portion of the revolver 26 wherethe revolver 26 contacts the attachment and to acquire identificationinformation of the attachment 25 a via this contact.

The control unit 60 can detect a code from an imaged captured by theside-view image capturing unit 45 and can determine the type of theattachment 25 a by decoding processing using a conventionally knownmethod. By determining the type of the attachment 25 a, it is possibleto grasp an outer diameter and a vertical dimension of the attachment 25a and to calculate a position of a lower end portion and a position ofan outer peripheral surface of the attachment 25 a.

Similarly, a code, an IC chip and the like can be attached to theobjective lens 25. In this case, the control unit 60 can also grasp thetype of the objective lens 25, that is, a length and an outer diameter(an outer shape) of the objective lens 25.

In this case, the storing unit 89 shown in FIG. 17 stores information onthe type, shape, dimensions of each part and the like of the objectivelens 25 in association with each other, and information on the shape anddimensions corresponding to the type of the objective lens 25 grasped bythe control unit 60 can be read from the storing unit 89 and grasped.Similarly, information on the attachment 25 a can also be stored in thestoring unit 89.

The storing unit 89 can also store information on the type and a workingdistance (WD) of the objective lens 25 in association with each other.As a result, it is possible to grasp the working distance of theobjective lens 25 in use by reading the information on the workingdistance corresponding to the type of the objective lens 25 grasped bythe control unit 60.

Configuration of Image Processing Unit 61

The image processing unit 61 shown in FIG. 17 is configured to acquirepositional relation information between the objective lens 25 and theobservation target 100 based on a side-view image acquired by theside-view image capturing unit 45. Specifically, the positional relationinformation between the objective lens 25 and the observation target 100can be acquired using an edge extracted by the edge extracting unit 62,and for example, as shown in FIG. 21, a distance in the verticaldirection between the uppermost observation target edge indication line71 a and the lower end portion of the objective lens edge indicationline 71 b is acquired as the positional relation information. As amethod of calculating this distance, for example, there is a method ofmultiplying an actual dimension per pixel of the side-view image and thenumber of pixels between the observation target edge indication line 71a and the objective lens edge indication line 71 b.

The image processing unit 61 may also be configured to acquirepositional relation information between the objective lens 25 and theobservation target 100 using the information on the shape or dimensionof the objective lens 25 stored in the storing unit 89. As describedabove, the control unit 60 can grasp the shape and dimension of theobjective lens 25, and can also grasp the shape and dimension of theattachment 25 when the attachment 25 a is attached. As a result, it ispossible to calculate a distance between the lower end portion of theobjective lens 25 and the upper surface of the observation target 100,and a distance between the lower end portion of the attachment 25 a andthe upper surface of the observation target 100 without extracting anedge of the objective lens 25.

For example, as shown in FIG. 21, by grasping the outer diameter of theobjective lens 25, an outer diameter indication line 73 indicating theouter diameter of the objective lens 25 can be displayed as a verticalline. When the objective lens 25 is swung, it is only necessary to tiltthe outer diameter indication line 73 corresponding to the swing angle.

The side-view image capturing unit 45 is provided on a side opposite tothe user side, and thus a layout can be made so as not to disturb theuser. However, since the side-view image capturing unit 45 captures animage from the side opposite to the user side, when the image isdisplayed as it is on the display unit 2, the relation between the leftand right becomes opposite to that viewed from the user side. The imageprocessing unit 61 is configured to have the image acquired by theside-view image capturing unit 45 displayed on the display unit 2 withthe left and right inverted. As a result, the left and right directionof the side-view image can be made to coincide with that viewed from theuser side.

Configuration of Autofocus Unit 63

The autofocus unit 63 controls the objective lens Z-axis directiondriving unit 80 based on the positional relation information between theobjective lens 25 and the observation target 100 acquired by the imageprocessing unit 61 and a magnified observation image acquired by themagnified observation image capturing unit 50, and searches for thefocus of the objective lens 25 by moving the objective lens 25 in thevertical direction. For example, the objective lens 25 is moved in thevertical direction by the objective lens Z-axis direction driving unit80 until the observation target 100 is focused by using an algorithmsimilar to a well-known phase difference autofocus or contrast AF. Itmay also be focused by moving the placement table 31 in the verticaldirection by the placement unit Z-direction driving unit 83.

Since the positional relation information between the objective lens 25and the observation target 100 is acquired in advance when focusing, theobjective lens Z-axis direction driving unit 80 can be controlled suchthat the objective lens 25 approaches the observation target 100 withina range in which the objective lens 25 and the observation target 100 donot collide with each other. Even with this control, the collisionbetween the objective lens 25 and the observation target 100 can beavoided. Therefore, even when the position of the objective lens 25after the completion of observation preparation is farther from theobservation target 100 than the focused range, focusing can still beperformed by autofocus.

The autofocus unit 63 can search for the focus of the objective lens 25using information on the working distance of the objective lens 25stored in the storing unit 89. The working distance of the objectivelens 25 largely differs depending on magnification of the objective lens25. However, by reading the information on the working distance of theobjective lens 25 from the storing unit 89 and controlling the objectivelens Z-axis direction driving unit 80 such that the observation target100 exists near the working distance of the objective lens 25, focusingby autofocus can be performed quickly and accurately. In this case, itis preferable to focus the objective lens 25 on an uppermost surface ofthe observation target 100. As a result, a collision between theobjective lens 25 and the observation target 100 can be avoided inadvance.

For example, the search for the focus of the objective lens 25 by theautofocus unit 63 may fail due to a low contrast or other reasons. Whenthe search for the focus of the objective lens 25 by the autofocus unit63 fails, the control unit 60 stops the objective lens Z-axis directiondriving unit 80 to end the search. In this way, the collision betweenthe objective lens 25 and the observation target 100 can be avoided inadvance. In addition, when the search for the focus of the objectivelens 25 by the autofocus unit 63 fails, a display notifying that thesearch has failed may be displayed on the display unit 2. The displaynotifying that the search has failed may include, for example, a messageor a mark indicating that the search has failed. However, the display isnot limited thereto. When the search for the focus of the objective lens25 by the autofocus unit 63 fails, it is also fine to notify by voicethat the search has failed.

In addition, the autofocus unit 63 may also control the objective lensZ-axis direction driving unit 80 only based on the magnified observationimage acquired by the magnified observation image capturing unit 50 andsearch the focus of the objective lens 25 by moving the objective lens25 in the vertical direction.

Receiving Unit

The controller unit 3, the mouse 4, and the keyboard 6 are receivingunits that receive a designation of an arbitrary position by the user inthe side-view image displayed on the display unit 2. The control unit 60is configured to control the magnifying observation apparatus A based onthe position received by the receiving unit. For example, the objectivelens Z-axis direction driving unit 80 is controlled such that theobjective lens 25 is focused on the position received by the receivingunit. The objective lens Z-axis direction driving unit 80 may also becontrolled such that the objective lens 25 moves to the positionreceived by the receiving unit.

When the search for the focus of the objective lens 25 by the autofocusunit 63 fails, it is also possible to receive a designation of a targetfocal position of the objective lens 25 from the user on the side-viewimage by operating the controller unit 3, the mouse 4, and the keyboard6. In other words, the receiving unit is configured to receive adesignation of a position from the user when the search for the focus ofthe objective lens 25 by the autofocus unit 63 fails. The positionreceived by the receiving unit can be specified on coordinates in avirtual space. For example, a coordinate system 1 may be used as acoordinate in the virtual space, a coordinate system 2 may be used as acoordinate at the pixel of the image sensor of the side-view imagecapturing unit 45, and a coordinate system 3 may be used as a coordinatein the side-view image displayed on the display unit 2. By associatingthe three coordinates, the position received by the receiving unit canbe specified.

The autofocus unit 63 controls the objective lens Z-axis directiondriving unit 80 based on the target focal position received by thereceiving unit. The objective lens Z-axis direction driving unit 80 iscontrolled to move the objective lens 25 in the vertical direction untilthe focus of the objective lens 25 moves to the target focal position.

The objective lens 25 may be moved after a designation of a target focalposition is received by the receiving unit, or the objective lens 25 maybe moved before a designation of a position is received by the receivingunit from the user. In a word, it may be configured such that, before adesignation of a position is received by the receiving unit from theuser, the objective lens Z-axis direction driving unit 80 is controlledbased on the positional relation information between the objective lens25 and the observation target 100 acquired by the image processing unit61 and the magnified observation image acquired by the magnifiedobservation image capturing unit 50 to search for the focus of theobjective lens 25.

As a control that reflects a designation of a position at the receivingunit, it includes, for example, a control of moving the observationtarget 100 by the placement table 31 in the width direction and thedepth direction of the placement table 31 such that the positionreceived by the receiving unit enters the visual field of the magnifiedobservation image capturing unit 50. When the user designates, forexample, a right end of a side-view image displayed on the display unit2 as the position, the control unit 60 controls the placement unitXY-direction driving unit 82 such that the designated position islocated in the vicinity of the central portion of the side-view image.The control unit 60 includes a Z-direction driving amount determiningunit which determines a driving amount of the Z-direction driving unitbased on a position in the Z direction of the magnifying observationapparatus 1 converted from the position in a second image designated bythe designation received by the receiving unit. Then, the control unit60 controls the Z-direction driving unit based on the driving amountdetermined by the Z-direction driving amount determining unit. As aresult, it becomes possible to designate a part to be observed and toobserve the designated part. Further, for example, it is also possibleto realize a control of a second imaging section in the depth directionby making it possible to grasp the position in the direction of thesecond imaging section by a stereo camera including a pair of camerasand the like.

The Z-direction driving amount determining unit may have an associationinformation storing unit that stores association information between theposition in the second image and the position in the Z direction of themagnifying observation apparatus 1. The Z-direction driving amountdetermining unit can determine a driving amount of the Z-directiondriving unit based on the position received by the receiving unit andthe association information.

Further, a plurality of objective lenses 25 attached to the revolver 26can be included in the side-view image by setting the angle of view ofthe side-view image capturing unit 45, etc. In this case, when the userdesignates a position corresponding to one objective lens 25 among theplurality of objective lenses 25 on the side-view image by the receivingunit, a designation of that position is received. The control unit 60controls the electric revolver driving unit 81 such that an observationby the objective lens 25 at the position received by the receiving unitbecomes possible. As a result, the electric revolver driving unit 81rotates the revolver 26 until the objective lens 25 at the positionreceived by the receiving unit comes to an observable position.

When position designation is performed, the display control unit 64causes a guide display which guides the user to designate a position tobe displayed on the display unit 2 such that the guide display overlapsthe side-view image. The guide display can be a display regarding theworking distance of the objective lens 25. For example, as indicated byreference numeral 76 in FIG. 40, the working distance of the objectivelens 25 can be a guide display by a graphic. The guide display 76 is ina form of a triangle having a vertex at the bottom, and this lowervertex is a portion indicating the working distance. In addition, asshown in FIG. 42, the guide display 76 may be a guide display in whichthe working distance of the objective lens 25 (lens WD) is indicated bya numerical value. In this case, the distance between the lower endportion of the objective lens 25 and the upper surface of theobservation target 100 may be displayed on the side-view image.

The guide display may be in a form of displaying the edge extracted bythe edge extraction unit 62 as the upper surface of the observationtarget 100. For example, the observation target edge indication line 71a shown in FIG. 21 can be used as the guide display. As a result, theuser can easily recognize the upper surface of the observation target100 on the display unit 2.

The receiving unit is configured to receive a designation of a positioncorresponding to the outer shape, that is, the contour, of theobservation target 100 in the side-view image displayed on the displayunit 2. As a result, the position designated by the user in theside-view image can be used as the outer shape of the observation target100. Therefore, for example, the position can be used in a control foravoiding the collision between the objective lens 25 and the observationtarget 100.

The receiving unit is configured to receive a designation of a positioncorresponding to the lower end portion of the objective lens 25 in theside-view image displayed on the display unit 2. As a result, theposition designated by the user in the side-view image can be used asthe lower end portion of the objective lens 25. Therefore, for example,the position can be used in a control for avoiding the collision betweenthe objective lens 25 and the observation target 100.

The receiving unit is configured to be capable of operating a positiondesignation pointer 77 displayed in the side-view image shown in FIG.31, FIG. 32, etc., and is configured to receive a designation of anarbitrary position of the side-view image by the position designationpointer 77. The shape and color of the position designation pointer 77are not particularly limited. A position designation auxiliary line 77 acan be displayed together with the position designation pointer 77. Theposition designation auxiliary line 77 a moves in the vertical directionin connection with the position designation pointer 77. Further, asshown in FIG. 34, when the head unit 22 is swung, the positiondesignation auxiliary line 77 a tilts corresponding to the swinging ofthe head unit 22.

Configuration of Synthesis Processing Unit 67

The synthesis processing unit 67 shown in FIG. 17 is apart performingdepth synthesis processing of generating a magnified observation imagefocused on all portions of a predetermined range in a height directionof the observation target 100 positioned within the visual field of themagnified observation image capturing unit 50. A depth synthesis imageis, when a height difference within a predetermined range in the heightdirection of the observation target 100 exceeds the depth of field ofthe objective lens 25, an image obtained by extracting and synthesizingonly focused portions from images captured by the magnified observationimage capturing unit 50 from different height directions. Conventionallyknown depth synthesis processing may be performed to generate a depthsynthesis image. In the depth synthesis processing, the magnifiedobservation image capturing unit 50 captures a plurality of still images(images before synthesis) while the objective lens 25 is moved by theobjective lens Z-axis direction driving unit 80 in the Z direction (theheight direction). By synthesizing focused regions of the capturedimages, a magnified observation image focusing on a wide range of thescreen is synthesized. In this case, tens to hundreds of still imagesare used depending on the range in the Z direction, movement pitch inthe Z direction, etc.

The control unit 60 controls the synthesis processing unit 67 such thatthe depth synthesis processing is performed with the position receivedby the receiving unit as an upper limit or a lower limit of thepredetermined range. As a previous step of the synthesis processing, thereceiving unit can receive a designation of a position corresponding toat least one of the upper limit and the lower limit of the predeterminedrange in the side-view image. For example, as shown in FIG. 25, theupper limit of the predetermined range may be designated by a brokenline 78, and the lower limit of the predetermined range may bedesignated by a broken line 79. The broken lines 78 and 79 can beseparately moved in the vertical direction by an operation of thecontroller unit 3 or the mouse 4 by the user. In this way, it ispossible to arbitrarily set the upper limit and the lower limit of thepredetermined range. “Coupled region” in FIG. 25 is a range in which thedepth synthesis processing is performed.

Configuration of Position Index Calculating Unit 66

The position index calculation unit 66 is a part calculating an indexrelated to the distance between the objective lens 25 and theobservation target 100 in an optical axis direction of the objectivelens 25, or the distance between the objective lens 25 and the uppersurface of the placement table 31 based on the side-view image acquiredby the side-view image capturing unit 45. The index can be displayed onthe display unit 2 and can be displayed superimposed on the side-viewimage. A superimposed display is to display by overlapping an index onan image captured by the side-view image capturing unit 45. When thehead unit 22 swings (tilts), the index tilts corresponding to the swingangle of the head unit 22.

The index can be an index related to the working distance or an indexrelated to the focal position of the objective lens 25. The indexrelated to the working distance of the objective lens 25 can bedisplayed on the display unit 2 as the guide display 76 shown in FIG. 40and FIG. 41. A lower vertex in the guide display 76 indicates the focalposition, and thus the guide display 76 can also be referred to as anindex related to the focal position.

The index can be an index related to a movement limit position of theobjective lens 25 in the optical axis direction of the objective lens25. As shown in FIG. 31, the lower end portion of the objective lens 25cannot be lowered below the upper surface of the observation target 100,and thus the movement limit position of the objective lens 25 is theupper surface of the observation target 100. The upper surface of theobservation target 100 can be displayed in the side-view image as anedge indication line 90 by edge extraction processing. The edgeindication line 90 becomes an index indicating a downward movement limitposition of the objective lens 25, and the index in this case indicatesthe observation target 100 present at the movement limit position of theobjective lens 25. An index indicating an upward movement limit positionof the objective lens 25 may also be displayed. The upward movementlimit position of the objective lens 25 is determined by the length ofthe objective lens 25, the structure of the objective lens Z-directiondriving unit 80, etc.

The control unit 60 controls the objective lens Z-direction driving unit80 such that the objective lens 25 is moved to the movement limitposition to the most when the receiving unit receives a designation of aposition of a portion exceeding a movement limit. As shown in FIG. 31,the movement limit is displayed by the edge indication line 90. However,it is conceivable that the user designates a position of a portioncloser to the upper surface of the placement table 31 than the edgeindication line 90, and according to this position designation, theobjective lens 25 collides with the observation target 100. In order toavoid this situation, when a position designation as shown in FIG. 31 isperformed, the position designation is ignored, or even if the positiondesignation is performed, it is not reflected in the control of theobjective lens Z-direction driving unit 80. In this way, the collisionbetween the objective lens 25 and the observation target 100 is avoided.For the same reason, the receiving unit can also be configured not toreceive a designation of a position of a portion exceeding the movementlimit. When a designation of a position of a portion exceeds themovement limit, a warning may be displayed on the display unit 2.

The index can be at least one of the distance between the objective lens25 and the observation target 100 and the distance between the objectivelens 25 and the placement table 31. The position of the lower endportion of the objective lens 25 can be obtained based on imageprocessing such as edge extraction and dimension information stored inthe storing unit 89. The position of the upper surface of theobservation target 100 can be obtained based on image processing such asedge extraction. As shown in FIG. 42, the distance between the lower endportion of the objective lens 25 and the upper surface of theobservation target 100 can be calculated from the position of the lowerend portion of the objective lens 25 and the position of the uppersurface of the observation target 100. Similarly, the distance betweenthe lower end portion of the objective lens 25 and the upper surface ofthe placement table 31 can also be calculated.

The index can also include the outline of the objective lens 25. Theoutline of the objective lens 25 can be obtained, for example, based onimage processing such as edge extraction, and shape information anddimension information stored in the storing unit 89. As shown in FIG.47, the outline of the objective lens 25A after the revolver 26 isrotated can be displayed by a broken line in the side-view image. As aresult, after the objective lens 25 is switched to the objective lens25A, it can be confirmed in advance whether the objective lens 25A afterswitching collides with the observation target 100. In a word, when theobjective lens 25 observing the observation target 100 is switched toanother objective lens 25A, the position index calculating unit 66 isconfigured to avoid a collision by making the outline of this anotherobjective lens 25A displayed on the display unit 2.

FIG. 48 shows a state in which the head unit 22 is swung. When the headunit 22 swings, the display of the objective lens 25A after switchingtilts corresponding to the swing angle of the head unit 22, and thus theuser can easily confirm the objective lens 25A after switching.

When the objective lens 25 observing the observation target 100 isswitched to another objective lens 25A, a track of movement of thisanother objective lens 25A can be displayed on the display unit 2. Whenthe objective lens 25 is switched, the objective lens 25 moves around arotation central line of the revolver 26. Therefore, the movement trackof the objective lens 25 can be calculated based on the shapeinformation and dimension information stored in the storing unit 89 andcan be displayed on the side-view image.

The index can also include at least one of a line indicating the uppersurface of the observation target 100 and a line indicating the uppersurface of the placement table 31. The line indicating the upper surfaceof the observation target 100 is, for example, the observation targetedge indication line 71 a shown in FIG. 21 or the edge indication line90 shown in FIG. 31. The line indicating the upper surface of theplacement table 31 is a placement table indication line 91 shown in FIG.31.

The position index calculating unit 66 acquires at least one of thedistance between the objective lens 25 and the observation target 100and the distance between the objective lens 25 and the placement table31 and determines whether the distance is equal to or lower than apredetermined distance. When the position index calculating unit 66determines that the distance is equal to or lower than the predetermineddistance, the position index calculating unit 66 can cause a warningdisplayed on the display unit 2. As shown in FIG. 46, when the distancebetween the objective lens 25 and the observation target 100 is shorterthan the working distance of the objective lens 25, it is conceivablethat the objective lens 25 does not focus even if the objective lens 25is lowered further and the objective lens 25 collides with theobservation target 100. Therefore, a warning display (warning messagedisplay) or a caution display (caution message display) of “Be carefulof collision” is performed. The warning display or the caution displaymay be not only characters but also a mark, a color, or a sound. Inaddition, when the objective lens 25 and the observation target 100approach each other with a distance equal to or greater than apredetermined distance, a color of a side view screen may be changed, ora warning display indicating the approaching may be performed. The colorof the side view screen may be changed according to the distance betweenthe objective lens 25 and the observation target 100.

The position index calculating unit 66 is configured to calculate anindex related to the downward movement limit position of the objectivelens 25 when the synthesis processing unit 67 causes the magnifiedobservation image capturing unit 50 to acquire a plurality of synthesisimages. It is necessary to set the range of depth synthesis by thesynthesis processing unit 67 such that the objective lens 25 does notcollide with the observation target 100. In this setting, the collisionbetween the objective lens 25 and the observation target 100 can beavoided by using the index related to the downward movement limitposition of the objective lens 25.

Display Control Unit 64

Besides controlling the display unit 2 as described above, the displaycontrol unit 64 shown in FIG. 17 is configured to change a displaymagnification of the side-view image according to the distance betweenthe objective lens 25 and the observation target 100 and to display theside-view image on the display unit 2. Specifically, as the distancebetween the objective lens 25 and the observation target 100 getssmaller, the display magnification of the side-view image is set larger,that is, the side-view image is magnified and displayed. For example,when the objective lens 25 has a high magnification, as shown in FIG.43, the working distance is several mm or less, and it may be difficultto understand the distance between the objective lens 25 and theobservation target 100 in the side-view image. In such a case, byincreasing the display magnification of the side-view image, as shown inFIG. 44, the lower end portion of the objective lens 25 and theobservation target 100 is magnified and displayed on the display unit 2,and the distance between the lower end portion of the objective lens 25and the observation target 100 can be easily grasped. The displaymagnification of the side-view image may be increased stepwise or may beincreased almost steplessly. The display magnification of the side-viewimage may be changed in connection with the change of the distancebetween the objective lens 25 and the observation target 100, or may bechanged manually by the user.

In this example, since the head unit 22 can be swung, the side-viewimage capturing unit 45 may image the observation target 100 or theobjective lens 25 while the head unit 22 swings. The display controlunit 64 can cause the side-view image captured by the side-view imagecapturing unit 45 while the head unit 22 swings to be displayedsimultaneously with the image captured by the magnified observationimage capturing unit 50 on the display unit 2.

Configuration of Leveling Unit 68

The leveling unit 68 shown in FIG. 17 is a part that performs imageprocessing such that the placement table 31 in the side-view image issubstantially horizontal when the head unit 22 swings. In other words,when the side-view image capturing unit 45 acquires a side-view image,as in Embodiment 4 shown in FIG. 10 and FIG. 11, for example, as theside-view image capturing unit 45 is displaced around the axis U withthe swinging of the head unit 22, the placement table 31 tiltscorresponding to the swing angle of the head unit 22 in the acquiredside-view image. In this case, the side-view image is displayed on thedisplay unit 2 after the leveling unit 68 performs image processing ofrotating the side-view image such that the placement table 31 issubstantially horizontal. Therefore, it is possible to make theside-view image an image with less discomfort when the observationtarget 100 is observed from a plurality of different angles.

The leveling unit 68 can also be configured to perform, besides imageprocessing of rotating the side-view image such that the placement table31 is substantially horizontal, trimming processing so as to form asubstantially rectangular image which is long in the horizontaldirection and which includes the placement table 31. The substantiallyrectangular image which is long in the horizontal direction is an imageshown in FIG. 16, and is an image substantially similar to a shape of adisplay region of a general display unit 2.

The leveling unit 68 may be a part that performs image processing asdescribed above, or may be a structure attached so that the side-viewimage capturing unit 45 is not displaced as in Embodiments 1 to 3, 5 and6. In Embodiments 1 to 3, 5 and 6, since the side-view image capturingunit 45 is not displaced, the horizontal direction of the side-viewimage capturing unit 45 before swinging is maintained in a horizontalstate even if the objective lens 25 swings.

Fully Automatic Observation

Next, a case of performing a fully automatic observation by themagnifying observation apparatus A will be described. As shown in theflow chart of FIG. 18, first, the user sets the observation target 100on the placement table 31 in step SA1. Then, the magnified observationimage acquired by the magnified observation image capturing unit 50 isdisplayed in the magnified observation image display region 70 a and theside-view image acquired by the side-view image capturing unit 45 isdisplayed in the side-view image display region 70 b by the userinterface 70 as shown in FIG. 16. In step SA2, the user views themagnified observation image displayed in the magnified observation imagedisplay region 70 a. In step SA3, it is determined whether the magnifiedobservation image displayed in the magnified observation image displayregion 70 a is a focused image or not, and when it is a focused image,the process proceeds to step SA5 to perform an observation. When it isnot a focused image, the process proceeds to step SA4 and an observationstart operation is performed. The observation start operation can beperformed by the controller unit 3, the mouse 4, and the keyboard 6,etc. For example, the observation start operation may be an operating ofclicking an observation start button or the like displayed in the userinterface 70 shown in FIG. 16.

As the observation start operation is performed, the process proceeds toa flow chart shown in FIG. 19. Before entering the processing of theflow chart, a coordinate in the virtual space, a coordinate at the pixelof the image sensor of the side-view image capturing unit 45, and acoordinate in the side-view image displayed on the display unit 2 areassociated with each other as pre-processing. The pre-processing may beperformed before focusing, or may be performed before shipment or aftershipment of the magnifying observation apparatus A, or at any time.

The process proceeds to step SB1 in the flow chart of FIG. 19, and avertical Z position and lens information are acquired. The vertical Zposition is the position of the objective lens 25 and the position ofthe placement table 31. The lens information is information related tothe type, shape, dimension of each part, etc. of the objective lens 25stored in the storing unit 89.

Then, the process proceeds to step SB2, and calibration data is acquiredto perform calibration processing. In step SB3, a side-view imagecaptured by the side-view image capturing unit 45 is acquired. It is animage as shown in FIG. 20. In step SB4, edge extraction processing isperformed. As a result, as shown in FIG. 21, the observation target edgeindication line 71 a and the objective lens edge indication line 71 bcan be displayed.

The process proceeds to step SB5, and a current position of theobjective lens 25 is grasped. This can be acquired by a linear scale, orcan be acquired by the position of the objective lens edge indicationline 71 b. In step SB5, an upper surface height (Z coordinate) of theobservation target 100 is grasped. This can be acquired by the positionof the observation target edge indication line 71 a. Further, in stepSB5, a current focusing position of the objective lens 25 is grasped.This can be acquired by the working distance of the objective lens 25.

The process proceeds to step SB6, and focusing condition calculationprocessing is performed. In this step, it is calculated how to move theobjective lens 25 in order to focus on the upper surface of theobservation target 100. Since the distance from the objective lens 25 tothe upper surface of the observation target 100 and the working distanceof the objective lens 25 are grasped, the moving direction and movingdistance of the objective lens 25 for focusing on the upper surface ofthe observation target 100 can be calculated.

In step SB7, collision condition calculation processing is performed. Inthis step, the collision condition is calculated as to how the objectivelens 25 is moved to collide with the observation target 100 or theplacement table 31. Since the positional relation between the distancefrom the objective lens 25 to the upper surface of the observationtarget 100 and the upper surface of the observation target 100 below theobjective lens 25 is grasped, it is possible to calculate the conditionunder which the objective lens 25 collides with the observation target100 or the placement table 31.

Step SB8 is a step performed before moving the objective lens 25. Instep SB8, when the objective lens 25 is moved as calculated in step SB6,it is determined whether the collision condition calculated in step SB7is met or not. When it is determined YES in step SB8 and there is apossibility that the objective lens 25 may collide with the observationtarget 100 or the placement table 31, the process proceeds to step SB10and a warning message is displayed superimposed on the side-view image.The warning message is, for example, “Be careful of collision” shown inFIG. 46. Thereafter, the process proceeds to a flow chart of asemi-automatic observation or a manual observation.

On the other hand, when it is determined NO in step SB8 and there is nopossibility that the objective lens 25 will collide with the observationtarget 100 or the placement table 31, the process proceeds to step SB9and the objective lens 25 is moved to a focusing position. At this time,a focus position may be searched by the autofocus unit 63 and a focusvalue may be displayed on the display unit 2.

The autofocus function (automatic focusing function) at the time of thefully automatic observation described above can be performed after anoperation having a possibility of defocusing. Examples of the operationhaving a possibility of defocusing include moving the placement table 31in the X direction or the Y direction, rotating the placement table 31,swinging the head unit 22, switching the objective lens 25, etc. Inaddition, a timer imaging mode in which imaging is performed atpredetermined time intervals can be incorporated in the control unit 60.In this case, focusing can be performed by the autofocus function beforeimaging. In addition, it is possible to recognize based on the side-viewimage that the observation target 100 has been placed on the placementtable 31 and to perform automatic focusing by the autofocus functionafter the observation target 100 is placed on the placement table 31.

Semi-Automatic Observation

Next, a case of performing a semi-automatic observation by themagnifying observation apparatus A will be described. Steps SC1 to SC4in the flow chart of FIG. 28 are the same as the steps SA1 to SA4 in theflow chart of FIG. 18. In addition, step SC9 in the flow chart of FIG.28 is the same as the step SA5 in the flow chart of FIG. 18.

When it is determined in step SC3 that it is not a focused image, theprocess proceeds to step SC4 and the user views the side-view image.Thereafter, the user proceeds to step SC5 and designates a focusingposition. For example, in a case where the observation target 100includes a first portion 101 and a second portion 102 as shown in FIG.30, the side-view image from a direction of arrow B is displayed asshown in FIG. 31. When edge extraction is performed in a fully automaticobservation, it is attempted to focus on the position of the edgeindication line 90 on the uppermost surface. Therefore, when a surface101 a of FIG. 30 is to be observed, the surface 101 a in the magnifiedobservation image is not focused. In the semi-automatic observation, asshown in FIG. 31, the focusing position can be arbitrarily designated bythe position designation pointer 77.

Steps SD1 to SD5 in the flow chart of FIG. 29 are the same as the stepsSB1 to SB5 in the flow chart of FIG. 19. After steps SD1 to SD5, whenthe process proceeds to step SD6, an auxiliary display for assistingposition designation is displayed superimposed on the side-view image.The auxiliary display is, for example, the position designation pointer77 or position designation auxiliary line 77 a in FIG. 31, thin inkdisplay in FIG. 32, etc.

Thereafter, the process proceeds to step SD7, and input receptionprocessing of receiving a focusing position designated by the user isperformed. After receiving the focusing position designated by the user,the process proceeds to step SD8 and coordinates when the objective lens25 is moved to the focusing position designated by the user arecalculated. Steps SD9 to SD11 are the same processing and determinationas the steps SB6 to SB8 in the flow chart of FIG. 19. In addition, stepSD13 is the same processing as step SB10 in the flow chart of FIG. 19,and step SD12 is the same processing as step SB9 in the flowchart ofFIG. 19.

The designation of the focusing position by the user will be describedin detail with reference to FIG. 35A, FIG. 35B and FIG. 35C. In FIG.35A, the position designation pointer 77 and the position designationauxiliary line 77 a are displayed, and a straight line C indicating theoptical axis of the objective lens 25 is also displayed. As shown inFIG. 35B, when the user lowers the position designation pointer 77, theposition designation auxiliary line 77 a also lowers in connection.Then, when the position designation pointer 77 and the positiondesignation auxiliary line 77 a reach a height that the user wants todesignate as the focusing position, a position designation operation(button operation of the mouse 4, etc.) is performed. As a result, theinput of the focusing position designated by the user is completed.

Thereafter, as shown in FIG. 35C, the objective lens 25 moves such thatthe focusing position of the objective lens 25 becomes the focusingposition designated by the user.

FIG. 36 shows a state in which the head unit 22 is swung. When the headunit 22 swings, the position designation auxiliary line 77 a tiltscorresponding to the swing angle of the head unit 22. Therefore, theuser can easily input a position.

As shown in FIG. 37, a lower limit indication line 95 indicating thelower limit of the position designation may be displayed in theside-view image. For example, the uppermost surface of the observationtarget 100 may be extracted as an edge by edge extraction processing,and the lower limit indication line 95 can be generated using this edgeas the lower limit of the position designation. The lower limitindication line 95 may be input by the user.

When the process proceeds to the semi-automatic observation in the flowchart shown in FIG. 19, the processing of step SD6 in the flow chartshown in FIG. 29 is performed.

On the other hand, by going through step SC5 in the flow chart shown inFIG. 28, it is possible to focus on the position designated by the useras described above. Therefore, the process proceeds to step SC6 and themagnified observation image is viewed. In step SC7, it is determinedwhether the magnified observation image displayed in the magnifiedobservation image display region 70 a is a focused image or not, andwhen it is determined as a focused image, the process proceeds to stepSC9 to perform an observation. When it is not a focused image, theprocess proceeds to step SC9 and various superimposed displays(superimposed display on the side-view image) and warning displays areperformed. The superimposed display can include, for example, a guidedisplay (shown by reference numeral 76 in FIG. 40) indicating theworking distance of the objective lens 25, etc.

Manual Observation

Next, a case of performing a manual observation by the magnifyingobservation apparatus A will be described. Steps SE1 to SE3 in the flowchart of FIG. 38 are the same as the steps SA1 to SA3 in the flow chartof FIG. 18. In step SE4, the user views the side-view. The guide display76 as a position index shown in FIG. 40, a distance shown in FIG. 42,etc., are superimposed and displayed in the side-view.

In step SE5, the user moves the objective lens 25. Then, the processproceeds to step SE6. In step SE6, the focusing position is adjustedwhile viewing the magnified observation image. In this case, since it ispossible to move the objective lens 25 while viewing the side-view asshown in FIG. 41 and FIG. 43, a standard of the focusing position can beknown. In a word, at the time of manual operation, it is possible tofocus while viewing both the magnified observation image and theside-view image.

When focusing is finished in step SE7, the process proceeds to step SE8and the magnified observation image is viewed. In step SE9, it isdetermined whether the magnified observation image displayed in themagnified observation image display region 70 a is a focused image ornot, and when it is determined as a focused image, the process proceedsto step SE11 to perform an observation. When it is not a focused image,the process proceeds to step SE10 and various superimposed displays(superimposed display on the side-view image) and warning displays areperformed. The superimposed display can include, for example, a guidedisplay (shown by reference numeral 76 in FIG. 40) indicating theworking distance of the objective lens 25, etc.

Details of the manual observation will be described. Steps SF1 to SF4 inthe flow chart shown in FIG. 39 are the same processing as steps SB1 toSB4 in the flow chart shown in FIG. 19. In step SF5, a position index ofthe working distance and the like of the objective lens 25 iscalculated. In step SF6, the position index calculated in step SF5 andthe side-view image are synthesized to create display data. This may beperformed by the display control unit 64 or may be performed by thecontrol unit 60.

Then, the process proceeds to step SF7 and the magnified observationimage and the side-view image are displayed on the display unit 2. Instep SF8, a guide display which guides the user to designate a positionis displayed on the display unit 2 such that the guide display overlapsthe side-view image. Step SF9 is a step performed by the user, and theobjective lens 25 is moved.

In step SF10, the control unit 60 acquires positional information in theZ direction of the objective lens 25 in real time based on an output ofa linear scale. In step SF11, the position index is updated anddisplayed on the display unit 2 so as to correspond to the update of thepositional information in the Z direction of the objective lens 25. Forexample, when the objective lens 25 moves from a position shown in FIG.40 to a position shown in FIG. 41, the guide display 76, which alsofunctions as a position index, is updated at a predetermined timing suchthat the position moves from the position shown in FIG. 40 to theposition shown in FIG. 41. Similarly, when the objective lens 25 movesfrom a position shown in FIG. 42 to a position shown in FIG. 43, a valueindicating the distance between the objective lens 25 and theobservation target 100 is updated at a predetermined timing.

In step SF12, it is determined whether the distance between theobjective lens 25 and the observation target 100 is equal to or lessthan a predetermined distance. The predetermined distance may be, forexample, less than the working distance of the objective lens 25, and isa distance where the objective lens is not focused even if it approachescloser than the predetermined distance. That is, in step SF12, it can bedetermined whether the objective lens 25 and the observation target 100are too close to each other or not.

When it is determined NO in step SF12, the process proceeds to the endbecause there is no possibility that the objective lens 25 and theobservation target 100 collide with each other. On the other hand, whenit is determined YES in step SF12, there is a possibility that theobjective lens 25 and the observation target 100 collide with eachother. Therefore, the process proceeds to step SF13 and the display isswitched to display a warning.

Eucentric Observation

After the objective lens 25 is focused, the objective lens 25 is movedby the objective lens Z-axis direction driving unit 80 and the placementtable 31 is moved by the placement unit Z-direction driving unit 83while the focused state is maintained to arrange an observation targetportion of the observation target 100 in a position where the eucentricobservation is possible. As a result, even when the head unit 22 isswung, the observation target portion of the observation target 100 doesnot deviate from the visual field of the magnified observation imagecapturing unit 50 and the eucentric observation becomes possible.

Example of Display Form

FIG. 49A and FIG. 49B are display examples displayed on the userinterface 70 shown in FIG. 16 and show an auxiliary window 70 c. In theauxiliary window 70 c, a navigation image and a side-view image can beselectively displayed. The navigation image is an image obtained byimaging the observation target 100 from an upper side, and is an imagewith a range wider than the visual field of the objective lens 25. Thenavigation image can be acquired by moving the placement table 31 in theX direction and the Y direction by the placement unit XY-directiondriving unit 82 and performing processing of connecting the capturedimages each time. A side-view image of the auxiliary window 70 c shownin FIG. 49B is an image acquired by the side-view image capturing unit45. It can be automatically focused by the autofocus function beforeimaging.

The navigation image is displayed by selecting a navigation image tab 70d at an upper portion of the auxiliary window 70 c, and the side-viewimage is displayed by selecting a side-view image tab 70 e. In addition,by operating a “close” button 70 f, the auxiliary window 70 c can beclosed. The display of the auxiliary window 70 c is possible byproviding a display button (not shown) on the user interface 70 anddetecting an operation of this button.

Storing Image

The side-view image acquired by the side-view image capturing unit 45and the magnified observation image acquired by the magnifiedobservation image capturing unit 50 can be stored in the storing unit89. When the user performs an operation of storing an image, theside-view image and the magnified observation image acquired by imagingthe same observation target 100 are stored in association with eachother in the storing unit 89. Observation date and time, the name of theobservation target 100, etc. can also be stored in association with theimage in the storing unit 89.

Example of Observation Using Magnifying Observation Apparatus A

Next, a specific example of observation using the magnifying observationapparatus A will be described. FIG. 50 is a perspective view of theobservation target 100 used in this example, and is specifically anelectronic component. The observation target 100 includes a substrate103, a resistor 104, a connector 105, and a capacitor 106. The resistor104 and the connector 105 are provided protruding from an upper surfaceof the substrate 103. On the other hand, the capacitor 106 is providedin a recess 103 a formed in the substrate 103 and cannot be seen from aside surface.

It is assumed that the observation target 100 is set on the placementtable 31 such that the side-view image capturing unit 45 is positionedat a side of the observation target 100. The resistor 104 and thecapacitor 106 are observed in this order.

First, as shown in FIG. 51A, when the placement table 31 is moved by theplacement unit XY-direction driving unit 82 such that the resistor 104enters the visual field of the objective lens 25, as described in theautomatic observation field, the focus of the objective lens 25automatically matches the upper surface of the resistor 104, and thusthe resistor 104 can be observed. Reference numeral 76 is a guidedisplay indicating the working distance of the objective lens 25.

When the resistor 104 is observed in sequence, as shown in FIG. 51B, theconnector 105 is reflected behind the resistor 104 in the side-viewimage. In this case, the upper surface of the connector 105 is higherthan the upper surface of the resistor 104. Therefore, in the fullyautomatic observation, the focus of the objective lens 25 will match theupper surface of the connector 105 and the resistor 104 cannot beobserved. In this case, as described in the semi-automatic observationfield, the focus of the objective lens 25 matches the upper surface ofthe resistor 104 by designating the focal position as the upper surfaceof the resistor 104 or by designating the upper surface of the substrate103 as a lower limit of focus search. As a result, as shown in FIG. 51C,the resistor 104 can be observed even though the connector 105 ispresent in the rear portion.

When the placement table 31 is further moved by the placement unitXY-direction driving unit 82 and the capacitor 106 is to be observed asshown in FIG. 51D, the upper surface of the resistor 104 is designatedas the focal position and the upper surface of the substrate 103 isdesignated as the lower limit of the focus search. Therefore, thecapacitor 106 which is below the lower limit is not focused. Moreover,the recess 103 a cannot be confirmed in the side-view image, and thus asemi-automatic position designation is also a difficult situation.

In such a case, a manual observation is performed. That is, for example,by superimposing and displaying the working distance of the objectivelens 25 as the reference numeral 76 on the side-view image, theobjective lens 25 can be manually moved while predicting the focusingposition. As a result, as shown in FIG. 51E, an observation can beeasily performed even on a portion that cannot be seen from the side.

Effect of Embodiment

As described above, according to the magnifying observation apparatus Aaccording to the embodiment, the side-view image capturing unit 45 thatacquires an image including at least the upper surface of theobservation target 100 is provided separately from the magnifiedobservation image capturing unit 50 that receives reflected light ortransmitted light from the observation target 100 via the objective lens25. Since the autofocus can be executed after the positional relationinformation between the objective lens 25 and the observation target 100is acquired, the function of autofocus can be fully utilized whileavoiding the collision between the objective lens 25 and the observationtarget 100.

Furthermore, the user can designate an arbitrary position in theside-view image captured by the side-view image capturing unit 45 andthe magnifying observation apparatus A is controlled based on theposition designation. Therefore, it is possible to easily obtain amagnified observation image in which the user's intention is reflected.

Moreover, based on the side-view captured by the side-view imagecapturing unit 45, an index related to the distance between theobjective lens 25 and the observation target 100 or the distance betweenthe objective lens 25 and the placement table 31 can be calculated anddisplayed on the display unit 2. Therefore, it is possible to supportthe operation the user performs at the time of observation and to workefficiently.

Further, when the side-view image is acquired by the side-view imagecapturing unit 45, the influence of the background can be reduced andthe placement table 31 and the observation target 100 can be easilygrasped.

In addition, it is possible to observe the observation target 100 from aplurality of different angles due to the eucentric mechanism. Moreover,separately from the magnified observation image, a side-view imageincluding the placement table 31 can be acquired and displayed on thedisplay unit 2.

The embodiments described above are merely illustrative in all respectsand should not be interpreted limitedly. Furthermore, all variations andmodifications belonging to equivalent scopes of the claims fall withinthe scope of the invention.

As described above, the magnifying observation apparatus according tothe invention can be used in cases of magnifying and observing a sampleof a micro object and the like, an electronic component, or work such asworkpiece.

What is claimed is:
 1. A magnifying observation apparatus whichirradiates an observation target with illumination light and detects alight receiving amount of reflected light or transmitted light of theillumination light from the observation target to generate an image ofthe observation target and to display the image to enable a magnifiedobservation, wherein the magnifying observation apparatus includes: abase unit; a placement unit, which is supported by the base unit, forplacing the observation target; an objective lens on which the reflectedlight or the transmitted light of the illumination light from theobservation target is incident; a Z-direction driving unit which movesthe placement unit or the objective lens in a direction towards and awayfrom the other of the placement unit or the objective lens; a firstimaging section which receives the reflected light or the transmittedlight through the objective lens to acquire a first image; a secondimaging section which is provided to face the placement unit or theobservation target and to have an optical axis different from an opticalaxis of the first imaging section, and which acquires a second imageincluding the observation target; a display unit capable of displayingthe first image acquired by the first imaging section and the secondimage acquired by the second imaging section; a receiving unit whichreceives a designation of a position in the second image displayed onthe display unit; and a control unit which controls the Z-directiondriving unit based on the position received by the receiving unit,wherein the magnifying observation apparatus further includes aZ-direction driving amount determining unit which determines a drivingamount of the Z-direction driving unit based on a position in the Zdirection of the magnifying observation apparatus converted from theposition in the second image designated by the designation received bythe receiving unit, and the control unit controls the Z-directiondriving unit based on the driving amount determined by the Z-directiondriving amount determining unit.
 2. A magnifying observation apparatuswhich irradiates an observation target with illumination light anddetects a light receiving amount of reflected light or transmitted lightof the illumination light from the observation target to generate animage of the observation target and to display the image to enable amagnified observation, wherein the magnifying observation apparatusincludes: a base unit; a placement unit, which is supported by the baseunit, for placing the observation target; an objective lens on which thereflected light or the transmitted light of the illumination light fromthe observation target is incident; a Z-direction driving unit whichmoves the placement unit or the objective lens in a direction towardsand away from the other of the placement unit or the objective lens; afirst imaging section which receives the reflected light or thetransmitted light through the objective lens to acquire a first image; asecond imaging section which is provided to face the placement unit orthe observation target and to have an optical axis different from anoptical axis of the first imaging section, and which acquires a secondimage including the observation target; a display unit capable ofdisplaying the first image acquired by the first imaging section and thesecond image acquired by the second imaging section; a receiving unitwhich receives a designation of a position in the second image displayedon the display unit; and a control unit which controls the Z-directiondriving unit based on the position received by the receiving unit,wherein the magnifying observation apparatus includes a driving unitwhich moves the placement unit or the objective lens in a directiontowards and away from each other, an autofocus unit which controls thedriving unit based on the first image acquired by the first imagingsection and searches for a focus of the objective lens, and an imageprocessing unit which acquires positional relation information betweenthe objective lens and the observation target based on the second imageacquired by the second imaging section, and wherein the control unitcontrols the driving unit such that the objective lens is focused on theposition received by the receiving unit, and the autofocus unit isconfigured to control, before a designation of a position is received bythe receiving unit from a user, the driving unit based on the positionalrelation information acquired by the image processing unit and the firstimage acquired by the first imaging section to search for the focus ofthe objective lens.
 3. The magnifying observation apparatus according toclaim 2, wherein the receiving unit is configured to receive adesignation of a position from a user when the search for the focus ofthe objective lens by the autofocus unit fails.
 4. The magnifyingobservation apparatus according to claim 1, wherein the receiving unitis configured to receive a designation of a position corresponding to anouter shape of the observation target in the second image.
 5. Themagnifying observation apparatus according to claim 1, wherein thesecond imaging section acquires a second image including at least alower end portion of the objective lens, and the receiving unit isconfigured to receive a designation of a position corresponding to thelower end portion of the objective lens in the second image.
 6. Themagnifying observation apparatus according to claim 1, wherein themagnifying observation apparatus includes an electric revolver drivingunit which rotates a revolver to which a plurality of the objectivelenses can be attached, the second imaging section acquires a secondimage including a plurality of the objective lenses, the receiving unitis configured to receive a designation of a position corresponding toone of the plurality of objective lenses in the second image, and thecontrol unit controls the electric revolver driving unit such that anobservation from the objective lens at a position received by thereceiving unit becomes possible.
 7. The magnifying observation apparatusaccording to claim 1, wherein the magnifying observation apparatusincludes a synthesis processing unit which performs depth synthesisprocessing of generating a first image focusing on all parts of apredetermined range in a height direction of the observation targetpositioned within visual field of the first imaging section, thereceiving unit is configured to receive a designation of a positioncorresponding to at least one of an upper limit and a lower limit of thepredetermined range in the second image, and the control unit controlsthe synthesis processing unit such that the depth synthesis processingis performed with the position received by the receiving unit as theupper limit or the lower limit of the predetermined range.
 8. Themagnifying observation apparatus according to claim 1, wherein theplacement unit includes an electric placement table, and the controlunit controls the electric placement table such that the positionreceived by the receiving unit enters the visual field of the firstimaging section.
 9. The magnifying observation apparatus according toclaim 8, wherein the second imaging section is positioned above an uppersurface of the electric placement table and images the observationtarget in a depth direction of the electric placement table, theelectric placement table is configured to be capable of moving theobservation target in both a width direction and a depth direction ofthe electric placement table, and the electric placement table moves theobservation target in the width direction and the depth direction of theelectric placement table such that the position received by thereceiving unit enters the visual field of the first imaging section. 10.The magnifying observation apparatus according to claim 1, wherein themagnifying observation apparatus includes a display control unit whichcontrols the display unit, and the display control unit causes a guidedisplay which guides a user to designate a position to be displayed onthe display unit such that the guide display overlaps the second image.11. The magnifying observation apparatus according to claim 10, whereinthe guide display is a display regarding a working distance of theobjective lens.
 12. The magnifying observation apparatus according toclaim 10, wherein the second imaging section acquires a second imageincluding at least an upper surface of the observation target, themagnifying observation apparatus includes an edge extracting unit whichperforms edge extraction processing of extracting the upper surface ofthe observation target included in the second image as an edge, and theguide display is to display the edge extracted by the edge extractingunit as the upper surface of the observation target.
 13. The magnifyingobservation apparatus according to claim 1, wherein the receiving unitis configured to be capable of operating a position designation pointerdisplayed in the second image and the receiving unit receives adesignation of an arbitrary position by the position designationpointer.
 14. The magnifying observation apparatus according to claim 1,wherein the Z-direction driving amount determining unit includes anassociation information storing unit which stores associationinformation between a position in the second image and a position in theZ direction of the magnifying observation apparatus, and the Z-directiondriving amount determining unit determines a driving amount of theZ-direction driving unit based on the position received by the receivingunit and the association information.
 15. The magnifying observationapparatus according to claim 2, wherein the magnifying observationapparatus includes a display control unit which controls the displayunit, and the display control unit causes a guide display which guides auser to designate a position to be displayed on the display unit suchthat the guide display overlaps the second image.
 16. The magnifyingobservation apparatus according to claim 15, wherein the guide displayis a display regarding a working distance of the objective lens.
 17. Themagnifying observation apparatus according to claim 2, wherein theplacement unit includes an electric placement table, and the controlunit controls the electric placement table such that the positionreceived by the receiving unit enters the visual field of the firstimaging section.
 18. The magnifying observation apparatus according toclaim 8, wherein the magnifying observation apparatus further includes aZ-direction driving amount determining unit which determines a drivingamount of the Z-direction driving unit based on a position in the Zdirection of the magnifying observation apparatus converted from theposition in the second image designated by the designation received bythe receiving unit, and the control unit controls the Z-directiondriving unit based on the driving amount determined by the Z-directiondriving amount determining unit.
 19. The magnifying observationapparatus according to claim 2, wherein the magnifying observationapparatus includes an electric revolver driving unit which rotates arevolver to which a plurality of the objective lenses can be attached,the second imaging section acquires a second image including a pluralityof the objective lenses, the receiving unit is configured to receive adesignation of a position corresponding to one of the plurality ofobjective lenses in the second image, and the control unit controls theelectric revolver driving unit such that an observation from theobjective lens at a position received by the receiving unit becomespossible.
 20. The magnifying observation apparatus according to claim 2,wherein the placement unit includes an electric placement table, and thecontrol unit controls the electric placement table such that theposition received by the receiving unit enters the visual field of thefirst imaging section.